-- Logs begin at Thu 2022-06-16 13:58:43 UTC, end at Thu 2022-06-16 15:19:41 UTC. -- Jun 16 14:47:05.187572 dv-cinder-837165-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 14:47:05.199442 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 14:47:05.202418 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 14:47:05 2022] *** Jun 16 14:47:05.202418 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 14:47:05.202418 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 14:47:05.202418 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: nodename: dv-cinder-837165-3-iscsi Jun 16 14:47:05.202418 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: machine: x86_64 Jun 16 14:47:05.202418 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: clock source: unix Jun 16 14:47:05.202418 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: pcre jit disabled Jun 16 14:47:05.202418 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: detected number of CPU cores: 4 Jun 16 14:47:05.202418 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: current working directory: / Jun 16 14:47:05.202418 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: detected binary path: /usr/bin/uwsgi-core Jun 16 14:47:05.202418 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: your processes number limit is 47680 Jun 16 14:47:05.202418 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: your memory page size is 4096 bytes Jun 16 14:47:05.202418 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: detected max file descriptor number: 2048 Jun 16 14:47:05.203801 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: lock engine: pthread robust mutexes Jun 16 14:47:05.203801 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: thunder lock: enabled Jun 16 14:47:05.203801 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 14:47:05.203801 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 14:47:05.254916 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: Python main interpreter initialized at 0x5623c260f9c0 Jun 16 14:47:05.254916 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: python threads support enabled Jun 16 14:47:05.254916 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: your server socket listen backlog is limited to 100 connections Jun 16 14:47:05.254916 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: your mercy for graceful operations on workers is 90 seconds Jun 16 14:47:05.255743 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 14:47:05.255743 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: *** Operational MODE: preforking *** Jun 16 14:47:05.255998 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: *** uWSGI is running in multiple interpreter mode *** Jun 16 14:47:05.255998 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: spawned uWSGI master process (pid: 109738) Jun 16 14:47:05.256076 dv-cinder-837165-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 14:47:05.257530 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: spawned uWSGI worker 1 (pid: 109739, cores: 1) Jun 16 14:47:05.257530 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: spawned uWSGI worker 2 (pid: 109740, cores: 1) Jun 16 14:47:05.257830 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 14:47:06.452463 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 14:47:06.557117 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 14:47:08.234851 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:47:08.234851 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: from cryptography.utils import int_from_bytes Jun 16 14:47:08.235617 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:47:08.235617 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: from cryptography.utils import int_from_bytes Jun 16 14:47:08.412930 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:47:08.412930 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: from cryptography.utils import int_from_bytes Jun 16 14:47:08.413797 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:47:08.413797 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: from cryptography.utils import int_from_bytes Jun 16 14:47:11.319073 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 14:47:11.319882 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 14:47:11.320251 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 14:47:11.320798 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 14:47:11.321120 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 14:47:11.321657 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.322051 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.322475 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.322930 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.323342 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.323732 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.324120 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.324619 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.325042 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.325375 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.325732 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.326068 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837165-3-iscsi {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.326402 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.326723 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.327043 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.327368 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.327686 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.328015 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.328328 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.328863 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.329541 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.329693 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.330109 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.330636 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.330892 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.331084 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.331415 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.331726 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.332167 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.332494 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.332939 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837165-3-iscsi {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.336317 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.336317 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.336317 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.336317 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.336317 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.336317 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.336317 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.336317 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.339074 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.339074 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.339074 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.339074 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.339714 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.339714 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.340022 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.340308 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.340758 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.341227 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.341620 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.341879 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.342288 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.342690 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.343179 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.343560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.343947 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.344208 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.344635 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.345112 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.345437 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.345759 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.346077 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.346395 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.346715 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.347031 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.347354 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.347671 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.348002 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.348326 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.348659 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.349000 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.349328 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.349747 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.350003 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.350319 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.350671 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.350998 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.351314 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.351638 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.351963 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.352280 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.352592 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.352930 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.353257 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.353599 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.354539 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.354725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.355040 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.355357 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.355681 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.355997 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.356311 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.356625 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.356971 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.357296 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.357611 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.357925 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.358238 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.358549 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.358864 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.359176 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.359854 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.359854 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.364326 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.364326 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.364326 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.364326 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.364326 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.364326 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.364326 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.364326 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.365480 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.365480 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.365480 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.366010 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.366010 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.366358 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.366759 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.367143 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.367576 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.367973 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.368357 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.368809 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.369167 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.369603 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.369967 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.370395 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.370829 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.371264 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.371604 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.372001 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.372363 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.372698 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.373053 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.373374 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.373692 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.374021 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.374372 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.374717 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.375070 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.375397 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.375741 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.376082 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.376410 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.376732 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.377082 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.377496 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.377958 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.378432 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.378937 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.379367 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.379704 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.380051 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.380379 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.380706 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.381068 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.381390 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.381717 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.382058 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.382392 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.382711 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.383064 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.383421 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.383746 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.384079 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.384467 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.385053 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.385465 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.385892 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.386284 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.386729 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.387135 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.387561 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.387880 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.388386 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.388787 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.389291 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.389712 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.390144 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.390602 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.390987 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.391453 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.391829 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.392337 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.392778 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.393209 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.393696 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.394080 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.394564 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.394966 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.395387 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.396045 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.396390 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.396711 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.397089 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.397410 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.397732 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.398052 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.398370 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.398687 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.399013 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.399328 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.399642 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.399978 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.400331 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.401288 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.401791 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.402283 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.402734 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.403069 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.403395 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.403727 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.404048 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.404368 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.404706 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.405066 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.405491 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.406137 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.406666 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.407225 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.407822 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.408417 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.409002 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.409206 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.409570 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.409982 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.410307 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.410627 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.410956 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.411300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.411601 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.411918 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.412236 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.412549 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.412913 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.413236 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.413555 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.413870 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.414178 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.414545 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.414861 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.415215 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.415738 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.416184 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.416702 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.417249 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.417703 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.418185 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.418553 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.418881 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.419396 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.419837 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.420299 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.420772 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.421226 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.421909 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.422655 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.423483 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.424148 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.425433 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.426046 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.426479 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.427011 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.427535 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.427977 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.428509 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.428890 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.429401 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.429848 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.430304 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.430734 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.431144 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.431609 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.432016 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.432421 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.432771 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.433134 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.433452 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.433788 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.434134 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.434480 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.434801 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.435127 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.435462 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.435783 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.436103 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.436425 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.436800 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.437290 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.437689 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.438336 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.438958 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.439491 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.440051 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.440629 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.441239 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.441740 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.442215 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.442692 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.443201 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.443730 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.444084 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.444428 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.444750 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.445099 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.445449 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.445765 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.446092 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.446411 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.446728 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.447083 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.447407 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.447754 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.448083 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.448420 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.448745 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.449095 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.449417 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.449821 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.450204 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.450632 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.451000 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.451451 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.451827 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.452285 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.452670 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.453015 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.453336 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.453660 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.453988 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.454299 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.454621 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.454949 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.455582 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.456163 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.456721 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.457506 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.458278 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.459057 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.459688 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.460129 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.460573 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.461021 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.461450 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.461853 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.462214 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.462629 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.463008 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.463954 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.464362 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.464788 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.465269 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.465645 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.466059 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.466401 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.466734 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.467151 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.467560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.467974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.468376 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.468782 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.469218 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.469645 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.470210 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.470891 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.471564 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.475054 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.475054 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.475054 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.475054 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.475054 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.475054 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.475054 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.475054 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.477138 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.477138 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.477138 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.477542 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.477994 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.478462 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.479001 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.479460 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.479916 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.480389 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.480873 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.481425 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.481853 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.482358 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.482826 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.483262 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.483763 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.484184 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.484703 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.485208 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.485843 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.486336 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.487240 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.487638 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.488032 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.488473 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.488929 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.489373 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.489792 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.490210 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.490716 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.491103 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.491538 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.491951 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.492371 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.492810 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.493281 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.493701 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.494120 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.494626 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.495078 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.495546 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.496050 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.496413 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.496777 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.497201 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.497618 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.498013 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.498467 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.498858 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.499239 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.499628 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.500012 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.500437 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.500819 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.501511 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.501908 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.502365 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.502823 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.503292 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.503802 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.504305 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.504761 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.505219 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.505660 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.506138 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.506606 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.507065 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.507625 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.508086 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.508603 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.509111 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.509664 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.510074 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.510567 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.511005 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.511548 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.512079 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.512556 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.513156 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.513692 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.514207 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.514757 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.515266 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.515732 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.516377 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.516824 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.517378 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.517896 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.518605 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.519013 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.519549 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.519994 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.520529 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.521315 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.521815 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.522503 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.523046 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.523567 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.524215 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.524765 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.525363 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.526534 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.527013 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.527469 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.528033 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.528510 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.529044 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.529468 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.529881 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.530294 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.530725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.531163 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.531573 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.531984 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.532403 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.532893 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.533331 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.533738 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.534343 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.534769 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.535194 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.535738 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.536160 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.536661 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.537128 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.537570 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.538004 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.538432 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.538860 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.539372 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.539838 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.540280 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.540705 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.541166 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.542179 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.542628 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.543130 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.543561 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.544005 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.544552 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.545025 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.545449 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.545880 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.546310 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.546815 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.547232 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.547652 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.548162 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.548584 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.549061 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.549511 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.549934 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.550357 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.550777 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.551190 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.551604 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.552042 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.552460 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.552993 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.553431 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.553860 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.554299 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.554787 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.555324 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.555816 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.556365 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.557011 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.557494 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.558084 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.558511 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.559090 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.559667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.560199 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.560688 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.561286 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.561822 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.562328 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.562868 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.563384 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.563887 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.564423 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.564936 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.565474 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.565981 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.566506 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.567021 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.567587 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.568056 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.568475 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.569042 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.569546 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.569962 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.570439 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.570858 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.571311 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.571726 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.572200 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.572640 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.573212 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.573702 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.574191 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.574633 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.575051 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.575476 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.576089 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.576483 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.576956 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.577420 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.577836 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.578238 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.578643 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.579047 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.579447 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.579914 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.580316 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.580998 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.581416 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.581812 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.582205 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.582599 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.582995 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.583423 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.583780 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.584170 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.584575 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.585028 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.585444 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.585847 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.586324 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.586742 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.587141 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.587542 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.587978 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.588939 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.589387 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.589791 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.590237 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.590632 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.591030 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.591424 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.591817 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.592207 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.592601 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.593036 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.593534 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.593930 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.594326 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.594719 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.595134 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.595553 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.596039 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.596580 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.597148 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.597567 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.598288 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.598680 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.599094 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.599497 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.599899 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.600365 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.600815 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.601273 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.601659 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.602071 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.602465 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.602855 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.603315 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.603729 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.604685 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.605113 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.605519 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.605909 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.606562 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.606996 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.607424 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.608049 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.608350 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.608755 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.609239 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.609671 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.610045 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.610509 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.610911 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.611301 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.611682 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.612079 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.612518 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.612951 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.613346 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.613749 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.614198 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.614642 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.615057 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.615479 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.615891 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.616310 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.616722 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.617191 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.617603 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.618235 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.618504 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.618888 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.619704 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.619933 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.620334 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.620786 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.621215 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.621636 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.622044 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.622434 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.622815 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.623222 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.623616 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.624054 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.624449 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.624868 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.625324 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.625718 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.626367 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.626775 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.627170 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.627584 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.627989 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.628446 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.628920 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.629305 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.629709 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.630096 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.630515 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.630918 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.631302 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.631689 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.632074 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.632458 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.632873 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.633333 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.633729 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.634118 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.634570 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.634992 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.635944 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.636403 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.636830 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.637283 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.637714 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.638138 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.638642 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.639063 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.639484 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.639929 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.640365 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.640803 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.641280 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.641693 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.642248 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.642705 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.643138 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.643566 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.643983 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.644414 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.644878 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.645311 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.645997 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.646406 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.646886 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.647334 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.647768 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.648208 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.648724 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.649183 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.649601 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.650020 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.650469 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.651463 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.651907 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.652317 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.652732 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.653178 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.653597 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.654015 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.654430 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.654868 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.655281 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.655698 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.656122 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.656531 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.656983 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.657393 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.657819 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.658228 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.658646 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.659124 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.659541 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.659949 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.660398 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.660858 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.661298 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.661722 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.662134 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.662553 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.663034 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.663544 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.663975 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.664436 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.664902 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.665345 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.665794 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.666222 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.667160 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.667582 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.667999 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.668456 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.669170 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.669529 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.669948 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.670385 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.670810 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.671241 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.671661 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.672132 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.672568 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.673062 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.673532 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.673959 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.674389 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.674816 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.675268 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.675690 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.676124 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.676553 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.677014 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.677449 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.677882 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.678347 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.678766 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.679353 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.679731 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.680152 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.680580 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.681062 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.681399 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 14:47:11.748933 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO dbcounter [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] Registered counter for database nova_api Jun 16 14:47:11.773057 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_db.sqlalchemy.engines [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:47:11.781009 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG dbcounter [-] [109740] Writer thread running {{(pid=109740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:47:11.849243 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.context [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5bf84c3a-2cb0-4224-8719-767e2c0696c7(cell1) {{(pid=109740) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 14:47:11.853764 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:11.855468 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:11.856336 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:11.858554 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:11.860692 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO dbcounter [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] Registered counter for database nova_cell0 Jun 16 14:47:11.865278 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO dbcounter [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] Registered counter for database nova_cell1 Jun 16 14:47:11.875331 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_db.sqlalchemy.engines [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:47:11.877731 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_db.sqlalchemy.engines [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:47:11.889170 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG dbcounter [-] [109740] Writer thread running {{(pid=109740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:47:11.890305 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 14:47:11.890949 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 14:47:11.891132 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 14:47:11.891508 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 14:47:11.891762 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 14:47:11.892152 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.892478 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.892973 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.893315 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.893650 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.893807 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG dbcounter [-] [109740] Writer thread running {{(pid=109740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:47:11.893959 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.894308 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.894629 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.894958 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.895219 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.895535 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.896239 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837165-3-iscsi {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.896578 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.896912 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.897267 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.897592 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.898011 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.898374 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.898680 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.899229 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.899545 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.899852 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.900330 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.900711 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.901765 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.902131 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.902465 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.902779 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.903109 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.903422 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.903836 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837165-3-iscsi {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.904315 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.904663 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.905009 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.905513 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.905851 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.906167 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.906579 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.906945 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.907319 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.907653 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.907980 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.908333 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.908651 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.909132 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.909491 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.909802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.910178 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.910495 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.910975 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.911268 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.911604 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.911921 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.912259 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.912585 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.912873 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.913179 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.913543 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.913872 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.914187 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.918563 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.918563 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.918563 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.918563 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.918563 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.918563 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.918563 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.918563 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.919766 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.919766 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.919766 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.919766 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.919766 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.919766 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.919766 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.920576 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.920576 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.920576 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.920948 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.921247 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.921588 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.921782 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.922022 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.922533 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.922937 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.923326 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.923580 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.923989 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.924360 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.924716 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.925083 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.925402 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.925716 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.926022 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.926333 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.926643 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.926952 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.927260 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.927568 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.927881 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.928188 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.928492 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.928797 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.929140 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.929459 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.929768 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.930075 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.930482 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.930828 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.931190 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.931496 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.931804 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.932262 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.932615 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.932945 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.933268 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.933591 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.934020 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.934402 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.934734 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.935050 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.935411 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.935756 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.936066 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.936386 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.936831 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.937168 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.937955 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.938283 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.938597 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.939048 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.939513 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.939854 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.940335 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.940662 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.941022 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.941478 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:47:11.941831 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.942177 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.942557 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.942883 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.943386 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.943830 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.944062 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.944410 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.944739 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.945119 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.945550 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.945928 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.946246 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.946575 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.946902 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.947266 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.948103 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.948544 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.948933 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.949216 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.949538 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.949903 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.950232 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.950716 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.951071 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.951426 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.951775 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.952085 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.952419 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.952736 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.953073 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.953388 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.953714 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.954053 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.954512 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.954876 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.955197 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.955525 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.955852 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.956173 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.956632 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.957043 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.957437 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.957793 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.958203 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.958605 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.958791 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.959271 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.959627 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.959936 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.960277 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.960588 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.960925 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.961394 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.961734 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.962070 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.962446 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.962881 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.963376 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.964311 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.964632 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.965059 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.965628 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.966044 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.966332 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.966644 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.966976 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.967289 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.967605 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.967936 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.968318 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.968687 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.969113 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.969432 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.969750 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.970095 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.970410 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.970743 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.971061 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.971516 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.971891 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.972229 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.972565 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.972921 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.973330 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.973718 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.974028 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.974344 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.974684 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.974994 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.975393 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.975710 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.976015 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.976323 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.976729 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.977102 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.977466 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.977806 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.978117 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.978430 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.978765 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.979314 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.979670 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.980090 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.980474 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.980910 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.981261 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.981590 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.981938 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.982264 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.982598 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.982953 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.983382 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.983705 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.984031 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.984378 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.984702 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.985050 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.985461 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.985918 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.986250 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.986564 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.986941 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.987294 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.987634 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.987957 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.988289 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.988667 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.989093 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.989460 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.989780 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.990099 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.990446 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.990775 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.991089 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.991467 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.991906 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.992247 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.992564 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.992944 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.993255 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.993689 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.994103 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.995033 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.995478 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.995829 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.996158 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.996473 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.996810 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.997233 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.997555 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.997932 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.998251 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.998578 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.998921 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.999234 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.999544 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:11.999863 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.000245 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.000610 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.000986 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.001334 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.001668 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.001983 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.002338 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.002668 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.003006 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.003283 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.003640 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.004131 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.004546 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.004882 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.005230 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.005667 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.005990 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.006937 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.006937 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.006937 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.007507 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.007715 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.008038 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.008493 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.008935 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.009309 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.009712 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.009946 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.010869 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.011252 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.011574 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.011903 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.012243 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.012563 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.012902 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.013213 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.013545 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.013966 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.014662 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.015022 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.015349 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.015670 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.016257 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.016669 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.017120 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.017458 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.017814 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.018155 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.018482 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.018798 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.019280 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.019608 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.019921 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.020236 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.020561 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.021174 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.021488 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.021884 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.022225 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.022536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.022936 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.023250 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.023571 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.023880 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.024245 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.024542 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.025004 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.025357 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.025671 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.026564 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.026874 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.027249 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.027604 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.027912 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.028252 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.028681 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.029051 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.029358 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.029679 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.030011 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.030325 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.030637 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.030942 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.031378 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.031898 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.032215 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.032560 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.032888 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.033366 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.033951 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.034247 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.034626 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.034874 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.035292 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.035733 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.036050 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.036354 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.036696 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.037036 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.037468 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.037818 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.038135 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.038447 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.038790 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.039121 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.039568 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.039909 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.040228 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.040570 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.040905 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.041952 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.042281 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.042594 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.042912 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.043274 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.043601 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.043996 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.044368 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.044702 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.045036 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.045375 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.045694 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.046146 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.046465 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.046775 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.047083 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.047423 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.047758 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.048251 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.048570 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.048908 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.049266 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.049912 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.050349 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.050717 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.051028 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.051378 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.051708 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.052184 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.052515 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.052858 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.053200 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.053523 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.053959 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.054327 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.054636 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.054945 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.055305 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.055623 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.056035 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.056451 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.056820 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.057212 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.057523 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.057871 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.058190 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.058605 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.058982 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.059339 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.059656 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.059971 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.060315 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.060634 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.061139 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.061464 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.061778 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.062100 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.062422 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.062873 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.063210 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.063521 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.063836 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.064395 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.064713 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.065195 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.065662 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.065981 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.066331 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.066699 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.067116 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.067435 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.067758 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.068109 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.068427 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.069006 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.069394 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.069713 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.070030 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.070373 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.070683 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.070997 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.071486 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.071802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.072111 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.072446 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.072872 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.073277 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.073608 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.074046 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.074397 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.074708 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.075220 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.075567 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.075893 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.076277 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.076605 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.077003 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.077347 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.077753 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.078168 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.078506 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.078835 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.079187 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.079509 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.080130 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.080465 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.080791 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.081173 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.081500 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.082051 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.082484 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.082937 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.083133 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.083497 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.083808 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.084257 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.084598 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.084942 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.085287 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.085625 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.086070 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.086394 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.086714 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.087062 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.087375 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.087818 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.088734 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.089080 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.089411 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.089768 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.090099 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.090426 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.090834 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.091243 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.091592 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.091909 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.092218 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.092557 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.093052 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.093406 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.093738 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.094133 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.094474 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.094791 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.095306 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.095661 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.095989 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.096341 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.096809 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.097189 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.097507 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.097827 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.098172 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.098480 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.098963 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.099363 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.099595 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.099938 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.100251 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.100789 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.101205 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.101622 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.101945 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.102262 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.102593 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.102910 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.103304 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.104538 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.104706 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.105015 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.105340 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.105687 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.106004 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.106329 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.106653 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.106971 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.107292 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.107615 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.107934 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.108254 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.108572 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.108929 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.109241 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.109565 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.109883 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.110469 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.110800 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.111115 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.111430 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.111750 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.112065 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.112383 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.112731 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.113083 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.113561 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.113911 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.114265 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.114592 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.114958 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.115354 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.115929 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.116080 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.116408 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.116757 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.117220 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.117671 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.117986 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.118306 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.118651 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.118976 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.119460 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.119795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.120116 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.120432 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.120787 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.121135 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.121567 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.121931 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.122270 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.122619 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.122977 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.123362 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.123768 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.124093 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.124692 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.125061 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.125675 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.126093 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.126427 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.126754 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.127107 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.127444 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.127872 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.128214 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.128581 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.129103 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.129477 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.129989 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.130340 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.130655 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.131039 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.131512 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.132187 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.132637 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.133082 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.133578 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.133914 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.134246 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.134610 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.134946 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.135373 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.135772 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.136163 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.136467 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.136779 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.137157 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.137549 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.138045 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.138398 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.138722 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.139065 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.139399 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.139782 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.140219 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.140500 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.140979 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.141489 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.141647 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.142054 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.142335 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.142786 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.143085 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.143403 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.143711 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.144140 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.144366 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.144893 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.145277 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.145876 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.146190 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.146528 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.146897 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.147343 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.147676 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.147998 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.148328 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.148702 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.149073 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.149817 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.150156 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.150483 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.151461 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.151836 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.152151 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.152465 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.152807 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.153177 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.153634 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.154067 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.154540 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.154892 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.155325 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.155695 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.156014 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.156328 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.156676 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.157320 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.157664 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.157981 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.158296 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.158658 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.159068 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.159502 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.159858 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.160178 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.160503 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.160896 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.161188 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.161660 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.162101 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.162454 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.162851 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.163062 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO dbcounter [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] Registered counter for database nova_cell0 Jun 16 14:47:12.163287 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.163564 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.164144 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.164490 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.164821 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.165220 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.165552 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.165857 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.166297 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.167271 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.167606 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.167923 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.168260 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.168614 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.169030 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.169325 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.169667 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.170115 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.170428 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.170743 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.171092 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.171414 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.171724 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.172031 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.172342 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.172694 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.173176 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.173487 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.173796 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.174134 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.174351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_db.sqlalchemy.engines [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:47:12.174542 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.174733 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.175136 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.175525 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.175853 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.176160 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.176521 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.176856 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.177171 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.177514 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.177931 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.178324 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.178679 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.179015 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.179361 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.179688 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.180146 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.180439 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG dbcounter [-] [109740] Writer thread running {{(pid=109740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:47:12.180658 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.180915 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.181203 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.181535 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.181879 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.182321 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.182738 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.183054 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.183374 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.183691 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.184060 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.184375 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.184689 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.185057 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.185682 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.185871 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.186241 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.186576 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.186902 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.187225 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.187570 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.188097 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.188431 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.188943 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.189305 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.189629 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.189949 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.190302 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.190624 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.191008 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.191598 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.191800 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.192173 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.192474 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.193054 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.193384 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.193747 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.194082 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.194499 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.194853 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.195214 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:47:12.195514 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 14:47:12.265948 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO dbcounter [None req-c8fd7019-dbe7-4247-9f1b-6d53e2af5377 None None] Registered counter for database nova_api Jun 16 14:47:12.290779 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG oslo_db.sqlalchemy.engines [None req-c8fd7019-dbe7-4247-9f1b-6d53e2af5377 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:47:12.301509 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG dbcounter [-] [109739] Writer thread running {{(pid=109739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:47:12.375183 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.context [None req-c8fd7019-dbe7-4247-9f1b-6d53e2af5377 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5bf84c3a-2cb0-4224-8719-767e2c0696c7(cell1) {{(pid=109739) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 14:47:12.380562 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG oslo_concurrency.lockutils [None req-c8fd7019-dbe7-4247-9f1b-6d53e2af5377 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:12.382665 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG oslo_concurrency.lockutils [None req-c8fd7019-dbe7-4247-9f1b-6d53e2af5377 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:12.383838 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG oslo_concurrency.lockutils [None req-c8fd7019-dbe7-4247-9f1b-6d53e2af5377 None None] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:47:12.387505 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG oslo_concurrency.lockutils [None req-c8fd7019-dbe7-4247-9f1b-6d53e2af5377 None None] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:47:12.391120 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO dbcounter [None req-c8fd7019-dbe7-4247-9f1b-6d53e2af5377 None None] Registered counter for database nova_cell0 Jun 16 14:47:12.396585 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO dbcounter [None req-c8fd7019-dbe7-4247-9f1b-6d53e2af5377 None None] Registered counter for database nova_cell1 Jun 16 14:47:12.409321 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG oslo_db.sqlalchemy.engines [None req-c8fd7019-dbe7-4247-9f1b-6d53e2af5377 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:47:12.413631 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG oslo_db.sqlalchemy.engines [None req-c8fd7019-dbe7-4247-9f1b-6d53e2af5377 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:47:12.420815 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG dbcounter [-] [109739] Writer thread running {{(pid=109739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:47:12.582582 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: WARNING keystonemiddleware.auth_token [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:47:12.585570 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG dbcounter [-] [109739] Writer thread running {{(pid=109739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:47:12.591407 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: WARNING keystonemiddleware.auth_token [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:47:12.597806 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO dbcounter [None req-c8fd7019-dbe7-4247-9f1b-6d53e2af5377 None None] Registered counter for database nova_cell0 Jun 16 14:47:12.608995 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG oslo_db.sqlalchemy.engines [None req-c8fd7019-dbe7-4247-9f1b-6d53e2af5377 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:47:12.614375 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG dbcounter [-] [109739] Writer thread running {{(pid=109739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:47:12.955216 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: WARNING keystonemiddleware.auth_token [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:47:12.961598 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: WARNING keystonemiddleware.auth_token [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:47:12.967115 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5623c260f9c0 pid: 109740 (default app) Jun 16 14:47:12.967787 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: WARNING keystonemiddleware.auth_token [None req-c8fd7019-dbe7-4247-9f1b-6d53e2af5377 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:47:12.969377 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:47:12.970707 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] 10.222.0.72 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002008 Jun 16 14:47:12.971408 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 1/1] 10.222.0.72 () {50 vars in 788 bytes} [Thu Jun 16 14:47:12 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:47:12.975584 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: WARNING keystonemiddleware.auth_token [None req-c8fd7019-dbe7-4247-9f1b-6d53e2af5377 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:47:13.459941 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: WARNING keystonemiddleware.auth_token [None req-c8fd7019-dbe7-4247-9f1b-6d53e2af5377 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:47:13.466872 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: WARNING keystonemiddleware.auth_token [None req-c8fd7019-dbe7-4247-9f1b-6d53e2af5377 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:47:13.472403 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x5623c260f9c0 pid: 109739 (default app) Jun 16 14:48:54.993446 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:54.994211 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003342 Jun 16 14:48:54.995834 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 2/2] 10.222.0.72 () {54 vars in 930 bytes} [Thu Jun 16 14:48:54 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:55.014979 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG dbcounter [-] [109739] Writing DB stats nova_api:SELECT=3 {{(pid=109739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:55.016063 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG dbcounter [-] [109739] Writing DB stats nova_cell0:SELECT=3 {{(pid=109739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:55.017004 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG dbcounter [-] [109739] Writing DB stats nova_cell1:SELECT=3 {{(pid=109739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:55.018011 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG dbcounter [-] [109739] Writing DB stats nova_cell0:SELECT=3 {{(pid=109739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:55.838048 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-02ad8b83-b02e-47b4-a850-d828ff746263 admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:55.891985 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-02ad8b83-b02e-47b4-a850-d828ff746263 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.888327 Jun 16 14:48:55.893031 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 1/3] 10.222.0.72 () {60 vars in 1291 bytes} [Thu Jun 16 14:48:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:48:59.084312 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:48:59.086780 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-1c0dc005-deba-4fac-9d06-f383c9f1c942 None None] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002844 Jun 16 14:48:59.087613 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 3/4] 10.222.0.72 () {54 vars in 930 bytes} [Thu Jun 16 14:48:59 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:48:59.171671 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-dec08845-1bed-4e1b-bd14-189e005e6dd7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "name": "cirros256", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "swap": 0, "ram": 256}} {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:59.192980 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:48:59.192980 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: warnings.warn(msg) Jun 16 14:48:59.243259 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-dec08845-1bed-4e1b-bd14-189e005e6dd7 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.144769 Jun 16 14:48:59.244342 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 2/5] 10.222.0.72 () {64 vars in 1282 bytes} [Thu Jun 16 14:48:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:48:59.264783 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG dbcounter [-] [109740] Writing DB stats nova_api:SELECT=3 {{(pid=109740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:59.265663 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG dbcounter [-] [109740] Writing DB stats nova_cell0:SELECT=3 {{(pid=109740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:59.267197 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG dbcounter [-] [109740] Writing DB stats nova_cell1:SELECT=3 {{(pid=109740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:59.268104 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG dbcounter [-] [109740] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:48:59.526250 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-44b56f81-6e87-4ecd-9fb7-082f46c8b810 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:48:59.528954 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:48:59.528954 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: warnings.warn(msg) Jun 16 14:48:59.628155 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-44b56f81-6e87-4ecd-9fb7-082f46c8b810 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.370387 Jun 16 14:48:59.629255 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 4/6] 10.222.0.72 () {64 vars in 1335 bytes} [Thu Jun 16 14:48:59 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:02.497104 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-dec08845-1bed-4e1b-bd14-189e005e6dd7 admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:02.499766 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-dec08845-1bed-4e1b-bd14-189e005e6dd7 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003421 Jun 16 14:49:02.500210 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 3/7] 10.222.0.72 () {54 vars in 930 bytes} [Thu Jun 16 14:49:02 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:02.668579 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-cc4a12b6-472c-408d-aafa-77bf517193e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "vcpus": 1, "swap": 0, "name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:02.704510 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:49:02.704510 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: warnings.warn(msg) Jun 16 14:49:02.736227 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-cc4a12b6-472c-408d-aafa-77bf517193e1 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.226348 Jun 16 14:49:02.737307 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 5/8] 10.222.0.72 () {64 vars in 1282 bytes} [Thu Jun 16 14:49:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:49:02.752799 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-3674f6da-7b1f-43df-a764-5a5d740040e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:02.755037 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:49:02.755037 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: warnings.warn(msg) Jun 16 14:49:02.795274 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-3674f6da-7b1f-43df-a764-5a5d740040e3 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047571 Jun 16 14:49:02.796456 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 4/9] 10.222.0.72 () {64 vars in 1335 bytes} [Thu Jun 16 14:49:02 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:05.325947 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-cc4a12b6-472c-408d-aafa-77bf517193e1 admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:05.326993 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-cc4a12b6-472c-408d-aafa-77bf517193e1 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Jun 16 14:49:05.327712 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 6/10] 10.222.0.72 () {54 vars in 930 bytes} [Thu Jun 16 14:49:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:05.434013 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-1c29c1d9-be2d-4b63-83ab-6b247cfdf702 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "ram": 1024, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:05.466720 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-1c29c1d9-be2d-4b63-83ab-6b247cfdf702 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.131360 Jun 16 14:49:05.468133 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 5/11] 10.222.0.72 () {64 vars in 1282 bytes} [Thu Jun 16 14:49:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:49:05.480403 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-5e7aec60-b43f-4473-981c-c76adf88c58b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:05.520105 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-5e7aec60-b43f-4473-981c-c76adf88c58b admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043015 Jun 16 14:49:05.521931 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 7/12] 10.222.0.72 () {64 vars in 1335 bytes} [Thu Jun 16 14:49:05 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:08.359873 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-1c29c1d9-be2d-4b63-83ab-6b247cfdf702 admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:08.360931 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-1c29c1d9-be2d-4b63-83ab-6b247cfdf702 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jun 16 14:49:08.361696 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 6/13] 10.222.0.72 () {54 vars in 930 bytes} [Thu Jun 16 14:49:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:49:08.457129 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-e1435d86-b66c-4b6d-9478-2fb3a2e083a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 2048, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:08.488202 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-e1435d86-b66c-4b6d-9478-2fb3a2e083a8 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.115176 Jun 16 14:49:08.489187 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 8/14] 10.222.0.72 () {64 vars in 1282 bytes} [Thu Jun 16 14:49:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 14:49:08.508439 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-20f5f2bd-7b51-40c4-81da-ac0ecfc407bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:08.544824 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-20f5f2bd-7b51-40c4-81da-ac0ecfc407bc admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041313 Jun 16 14:49:08.545880 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 7/15] 10.222.0.72 () {64 vars in 1335 bytes} [Thu Jun 16 14:49:08 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:11.046571 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-e1435d86-b66c-4b6d-9478-2fb3a2e083a8 admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:11.047653 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-e1435d86-b66c-4b6d-9478-2fb3a2e083a8 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002373 Jun 16 14:49:11.048068 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 9/16] 10.222.0.72 () {54 vars in 930 bytes} [Thu Jun 16 14:49:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:11.112550 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-9c2d34e0-2887-4874-919f-b35bf2cecc32 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "disk": 20, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:11.133129 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-9c2d34e0-2887-4874-919f-b35bf2cecc32 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078223 Jun 16 14:49:11.133702 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 8/17] 10.222.0.72 () {64 vars in 1282 bytes} [Thu Jun 16 14:49:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 14:49:11.148455 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-836129fa-33df-43be-a2f2-f2c956932655 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:11.182783 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-836129fa-33df-43be-a2f2-f2c956932655 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038778 Jun 16 14:49:11.183688 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 10/18] 10.222.0.72 () {64 vars in 1335 bytes} [Thu Jun 16 14:49:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:13.561094 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-9c2d34e0-2887-4874-919f-b35bf2cecc32 admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:13.562738 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-9c2d34e0-2887-4874-919f-b35bf2cecc32 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002092 Jun 16 14:49:13.564512 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 9/19] 10.222.0.72 () {54 vars in 930 bytes} [Thu Jun 16 14:49:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:13.664015 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-09638216-706c-4823-af49-77c4619422c2 admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:13.690744 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-09638216-706c-4823-af49-77c4619422c2 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.120465 Jun 16 14:49:13.691323 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 11/20] 10.222.0.72 () {60 vars in 1291 bytes} [Thu Jun 16 14:49:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:49:16.486368 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-9c2d34e0-2887-4874-919f-b35bf2cecc32 admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:16.487406 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-9c2d34e0-2887-4874-919f-b35bf2cecc32 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jun 16 14:49:16.488161 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 10/21] 10.222.0.72 () {54 vars in 930 bytes} [Thu Jun 16 14:49:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:49:16.581436 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-9cd62047-eed4-4560-bb0c-a508deeab5b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "swap": 0, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "disk": 1}} {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:16.619681 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-9cd62047-eed4-4560-bb0c-a508deeab5b2 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.123658 Jun 16 14:49:16.624900 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 12/22] 10.222.0.72 () {64 vars in 1282 bytes} [Thu Jun 16 14:49:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 14:49:16.644785 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-b6033113-f2ba-4ae5-88b1-9bb72f7dd244 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:16.689683 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-b6033113-f2ba-4ae5-88b1-9bb72f7dd244 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052341 Jun 16 14:49:16.691138 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 11/23] 10.222.0.72 () {64 vars in 1332 bytes} [Thu Jun 16 14:49:16 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:49:19.853878 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-9cd62047-eed4-4560-bb0c-a508deeab5b2 admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:19.855195 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-9cd62047-eed4-4560-bb0c-a508deeab5b2 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002123 Jun 16 14:49:19.855759 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 13/24] 10.222.0.72 () {54 vars in 930 bytes} [Thu Jun 16 14:49:19 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:49:19.968585 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-488f0cd5-df99-4928-8aee-6dd9c8e9a934 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "disk": 20, "name": "m1.small", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:19.999217 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-488f0cd5-df99-4928-8aee-6dd9c8e9a934 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.132050 Jun 16 14:49:19.999217 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 12/25] 10.222.0.72 () {64 vars in 1282 bytes} [Thu Jun 16 14:49:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:49:20.017007 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-3b71e2c1-3292-4aea-a0fc-ebc749c4f544 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:20.066710 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-3b71e2c1-3292-4aea-a0fc-ebc749c4f544 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056493 Jun 16 14:49:20.067829 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 14/26] 10.222.0.72 () {64 vars in 1332 bytes} [Thu Jun 16 14:49:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:23.311176 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-488f0cd5-df99-4928-8aee-6dd9c8e9a934 admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:23.312653 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-488f0cd5-df99-4928-8aee-6dd9c8e9a934 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002272 Jun 16 14:49:23.313120 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 13/27] 10.222.0.72 () {54 vars in 930 bytes} [Thu Jun 16 14:49:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:23.385587 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-c1262867-6876-4136-95da-06285ee1871a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "ram": 4096, "id": "3", "name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:23.408943 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-c1262867-6876-4136-95da-06285ee1871a admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.087820 Jun 16 14:49:23.409788 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 15/28] 10.222.0.72 () {64 vars in 1282 bytes} [Thu Jun 16 14:49:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:49:23.424075 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-0a417cf2-3f46-4315-bf59-f29e00d58a75 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:23.457711 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-0a417cf2-3f46-4315-bf59-f29e00d58a75 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037373 Jun 16 14:49:23.458339 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 14/29] 10.222.0.72 () {64 vars in 1332 bytes} [Thu Jun 16 14:49:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:26.441015 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-c1262867-6876-4136-95da-06285ee1871a admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:26.442527 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-c1262867-6876-4136-95da-06285ee1871a admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002433 Jun 16 14:49:26.442953 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 16/30] 10.222.0.72 () {54 vars in 930 bytes} [Thu Jun 16 14:49:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:26.535765 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-36558e14-182b-4fa0-a4e8-ee04c96287f5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192}} {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:26.541100 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG dbcounter [-] [109739] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=109739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:49:26.568928 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-36558e14-182b-4fa0-a4e8-ee04c96287f5 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.114091 Jun 16 14:49:26.570072 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 15/31] 10.222.0.72 () {64 vars in 1282 bytes} [Thu Jun 16 14:49:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:49:26.592961 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-7c33a985-8235-405d-a558-cf2ddc2575c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:26.625999 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-7c33a985-8235-405d-a558-cf2ddc2575c4 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046234 Jun 16 14:49:26.628181 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 17/32] 10.222.0.72 () {64 vars in 1332 bytes} [Thu Jun 16 14:49:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:49:29.391347 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-36558e14-182b-4fa0-a4e8-ee04c96287f5 admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:49:29.392825 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-36558e14-182b-4fa0-a4e8-ee04c96287f5 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002037 Jun 16 14:49:29.393986 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 16/33] 10.222.0.72 () {54 vars in 930 bytes} [Thu Jun 16 14:49:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:49:29.525058 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-370f7a15-4762-492e-bb2c-660a7feb2778 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "id": "5", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160}} {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:29.564295 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-370f7a15-4762-492e-bb2c-660a7feb2778 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.162256 Jun 16 14:49:29.565459 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 18/34] 10.222.0.72 () {64 vars in 1282 bytes} [Thu Jun 16 14:49:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:49:29.584943 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-a0107c8b-dc43-4745-b29f-cf425c91d9bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:49:29.627156 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-a0107c8b-dc43-4745-b29f-cf425c91d9bc admin admin] 10.222.0.72 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050836 Jun 16 14:49:29.627972 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 17/35] 10.222.0.72 () {64 vars in 1332 bytes} [Thu Jun 16 14:49:29 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:50:00.475802 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-370f7a15-4762-492e-bb2c-660a7feb2778 admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:00.476887 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-370f7a15-4762-492e-bb2c-660a7feb2778 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jun 16 14:50:00.477314 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 19/36] 10.222.0.72 () {54 vars in 930 bytes} [Thu Jun 16 14:50:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:50:00.489234 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG dbcounter [-] [109739] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=109739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:00.547137 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-c155bc58-a3d5-4b12-97f4-eaa83679c688 admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:00.568107 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-c155bc58-a3d5-4b12-97f4-eaa83679c688 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.083555 Jun 16 14:50:00.568687 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 18/37] 10.222.0.72 () {60 vars in 1291 bytes} [Thu Jun 16 14:50:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:50:01.732577 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-370f7a15-4762-492e-bb2c-660a7feb2778 admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:01.734546 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-370f7a15-4762-492e-bb2c-660a7feb2778 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002549 Jun 16 14:50:01.735314 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 20/38] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Jun 16 14:50:01 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:50:01.969273 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-ce2507db-7d10-4002-9209-0c25d753b68c admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:01.976483 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.wsgi [None req-ce2507db-7d10-4002-9209-0c25d753b68c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-ce2507db-7d10-4002-9209-0c25d753b68c admin admin] Request method failure captured: Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Accept: application/json Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Accept-Encoding: gzip, deflate Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Connection: keep-alive Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Content-Length: 0 Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Host: 10.222.0.72 Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Openstack-Api-Version: compute 2.90 Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Openstack-System-Scope: None Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: User-Agent: python-novaclient Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Auth-Token: gAAAAABiq0MZF1XVyXLDjCdSmup8EWMKqa95qSoqn6oUdFYJVS-r9FhZkR5-AGh9s0Q4v7w_6LlOXD3r_QowS3dgcN9UC86JDyQx3_Xsc2xh8rh5fw7CaRgFSHy-5dF7meJ8Kl7IRHOiFMc2Yx-rsimWZShpxCsvLQSZJdnDlL7AhtLGeJKBZVE Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Domain-Id: None Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Domain-Name: None Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Identity-Status: Confirmed Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Is-Admin-Project: True Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Project-Domain-Id: default Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Project-Domain-Name: Default Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Project-Id: 1304e58d14b64959b1e4ffc146293183 Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Project-Name: admin Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Role: member,admin,reader Jun 16 14:50:01.979907 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Roles: member,admin,reader Jun 16 14:50:01.982685 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1304e58d14b64959b1e4ffc146293183", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1304e58d14b64959b1e4ffc146293183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1304e58d14b64959b1e4ffc146293183"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1304e58d14b64959b1e4ffc146293183"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:50:01.982685 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Tenant: admin Jun 16 14:50:01.982685 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Tenant-Id: 1304e58d14b64959b1e4ffc146293183 Jun 16 14:50:01.982685 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Tenant-Name: admin Jun 16 14:50:01.982685 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-User: admin Jun 16 14:50:01.982685 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-User-Domain-Id: default Jun 16 14:50:01.982685 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-User-Domain-Name: Default Jun 16 14:50:01.982685 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-User-Id: b8adc1b6aec146cdaed3b9ac9a211c0a Jun 16 14:50:01.982685 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-User-Name: admin Jun 16 14:50:01.982685 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: method: > Jun 16 14:50:01.982685 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: exception: Flavor 42 could not be found. Jun 16 14:50:01.982685 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: action_args: {'id': '42'} Jun 16 14:50:01.982685 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:01.982685 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:01.984536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 14:50:01.984536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 14:50:01.984536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 14:50:01.984536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 14:50:01.984536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:50:01.984536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:50:01.984536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 14:50:01.984536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 14:50:01.984536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 14:50:01.984536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:01.984536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 14:50:01.984536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 14:50:01.984536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 14:50:01.984536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Jun 16 14:50:01.984536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:01.984536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Jun 16 14:50:01.984536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:01.984536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:01.984536 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:01.987078 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:01.987078 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:01.987078 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:01.987078 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:01.987078 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 14:50:01.987078 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:50:01.987078 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 14:50:01.987078 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Jun 16 14:50:01.987078 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:01.987078 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Jun 16 14:50:01.987078 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:01.987078 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:01.987078 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:01.987078 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:50:01.987078 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:50:01.987078 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 14:50:01.987078 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Jun 16 14:50:01.987078 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-ce2507db-7d10-4002-9209-0c25d753b68c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:01.990180 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-ce2507db-7d10-4002-9209-0c25d753b68c admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.073606 Jun 16 14:50:01.990180 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 19/39] 10.222.0.72 () {60 vars in 1190 bytes} [Thu Jun 16 14:50:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:01.995178 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-3e3d2823-34a5-47da-b045-ab4bfb1b94b4 admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:01.998412 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG dbcounter [-] [109740] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:50:02.019855 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-3e3d2823-34a5-47da-b045-ab4bfb1b94b4 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028251 Jun 16 14:50:02.020510 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 21/40] 10.222.0.72 () {60 vars in 1210 bytes} [Thu Jun 16 14:50:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:02.032118 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-36708ebe-16b9-46a0-b511-20895d843d80 admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:02.057482 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-36708ebe-16b9-46a0-b511-20895d843d80 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029129 Jun 16 14:50:02.058077 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 20/41] 10.222.0.72 () {60 vars in 1210 bytes} [Thu Jun 16 14:50:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:02.068329 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-31221d69-3107-4efd-a524-3dd79d0ec361 admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:02.075524 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.wsgi [None req-31221d69-3107-4efd-a524-3dd79d0ec361 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-31221d69-3107-4efd-a524-3dd79d0ec361 admin admin] Request method failure captured: Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Accept: application/json Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Accept-Encoding: gzip, deflate Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Connection: keep-alive Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Content-Length: 0 Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Host: 10.222.0.72 Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Openstack-Api-Version: compute 2.90 Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Openstack-System-Scope: None Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: User-Agent: python-novaclient Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Auth-Token: gAAAAABiq0MZF1XVyXLDjCdSmup8EWMKqa95qSoqn6oUdFYJVS-r9FhZkR5-AGh9s0Q4v7w_6LlOXD3r_QowS3dgcN9UC86JDyQx3_Xsc2xh8rh5fw7CaRgFSHy-5dF7meJ8Kl7IRHOiFMc2Yx-rsimWZShpxCsvLQSZJdnDlL7AhtLGeJKBZVE Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Domain-Id: None Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Domain-Name: None Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Identity-Status: Confirmed Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Is-Admin-Project: True Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Project-Domain-Id: default Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Project-Domain-Name: Default Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Project-Id: 1304e58d14b64959b1e4ffc146293183 Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Project-Name: admin Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Role: member,admin,reader Jun 16 14:50:02.079351 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Roles: member,admin,reader Jun 16 14:50:02.082058 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1304e58d14b64959b1e4ffc146293183", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1304e58d14b64959b1e4ffc146293183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1304e58d14b64959b1e4ffc146293183"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1304e58d14b64959b1e4ffc146293183"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:50:02.082058 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Tenant: admin Jun 16 14:50:02.082058 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Tenant-Id: 1304e58d14b64959b1e4ffc146293183 Jun 16 14:50:02.082058 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Tenant-Name: admin Jun 16 14:50:02.082058 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-User: admin Jun 16 14:50:02.082058 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-User-Domain-Id: default Jun 16 14:50:02.082058 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-User-Domain-Name: Default Jun 16 14:50:02.082058 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-User-Id: b8adc1b6aec146cdaed3b9ac9a211c0a Jun 16 14:50:02.082058 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-User-Name: admin Jun 16 14:50:02.082058 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: method: > Jun 16 14:50:02.082058 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: exception: Flavor 42 could not be found. Jun 16 14:50:02.082058 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: action_args: {'id': '42'} Jun 16 14:50:02.082058 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:02.082058 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:02.082974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 14:50:02.082974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 14:50:02.082974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 14:50:02.082974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 14:50:02.082974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:50:02.082974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:50:02.082974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 14:50:02.082974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 14:50:02.082974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 14:50:02.082974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:02.082974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 14:50:02.082974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 14:50:02.082974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 14:50:02.082974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Jun 16 14:50:02.082974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:02.082974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Jun 16 14:50:02.082974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:02.082974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:02.082974 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:02.084209 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:02.084209 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:02.084209 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:02.084209 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:02.084209 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 14:50:02.084209 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:50:02.084209 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 14:50:02.084209 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Jun 16 14:50:02.084209 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:02.084209 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Jun 16 14:50:02.084209 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:02.084209 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:02.084209 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:02.084209 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:50:02.084209 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:50:02.084209 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 14:50:02.084209 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Jun 16 14:50:02.084209 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-31221d69-3107-4efd-a524-3dd79d0ec361 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:02.085300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-31221d69-3107-4efd-a524-3dd79d0ec361 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016454 Jun 16 14:50:02.085300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 22/42] 10.222.0.72 () {60 vars in 1190 bytes} [Thu Jun 16 14:50:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 14:50:03.062390 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-36708ebe-16b9-46a0-b511-20895d843d80 admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:03.063538 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-36708ebe-16b9-46a0-b511-20895d843d80 admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Jun 16 14:50:03.064007 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 21/43] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Jun 16 14:50:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:50:03.282721 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-289d14af-319f-4a4f-9e0b-f804b05436c8 admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:03.289664 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.wsgi [None req-289d14af-319f-4a4f-9e0b-f804b05436c8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-289d14af-319f-4a4f-9e0b-f804b05436c8 admin admin] Request method failure captured: Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Accept: application/json Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Accept-Encoding: gzip, deflate Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Connection: keep-alive Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Content-Length: 0 Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Host: 10.222.0.72 Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Openstack-Api-Version: compute 2.90 Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Openstack-System-Scope: None Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: User-Agent: python-novaclient Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Auth-Token: gAAAAABiq0MbIbP-W3ADlDusMziiGrkTzxuG2JUMsVkQaVgJ8PQzJ0qvh06yBffIfEww2EGdYgD8v3tqIyfbzEK6Jqn1DF7nwH6G5zEzN5A6dO_IVlKzJu8a_thHD14UauUcjUewn-qbaGEiFY-TTGxLeKVHVBQ1j7s90lPwGKp8n9TY_WLHqxY Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Domain-Id: None Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Domain-Name: None Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Identity-Status: Confirmed Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Is-Admin-Project: True Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Project-Domain-Id: default Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Project-Domain-Name: Default Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Project-Id: 1304e58d14b64959b1e4ffc146293183 Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Project-Name: admin Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Role: member,admin,reader Jun 16 14:50:03.291300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Roles: member,admin,reader Jun 16 14:50:03.293830 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1304e58d14b64959b1e4ffc146293183", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1304e58d14b64959b1e4ffc146293183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1304e58d14b64959b1e4ffc146293183"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1304e58d14b64959b1e4ffc146293183"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:50:03.293830 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Tenant: admin Jun 16 14:50:03.293830 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Tenant-Id: 1304e58d14b64959b1e4ffc146293183 Jun 16 14:50:03.293830 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Tenant-Name: admin Jun 16 14:50:03.293830 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-User: admin Jun 16 14:50:03.293830 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-User-Domain-Id: default Jun 16 14:50:03.293830 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-User-Domain-Name: Default Jun 16 14:50:03.293830 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-User-Id: b8adc1b6aec146cdaed3b9ac9a211c0a Jun 16 14:50:03.293830 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-User-Name: admin Jun 16 14:50:03.293830 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: method: > Jun 16 14:50:03.293830 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: exception: Flavor 84 could not be found. Jun 16 14:50:03.293830 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: action_args: {'id': '84'} Jun 16 14:50:03.293830 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:03.293830 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:03.295667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 14:50:03.295667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 14:50:03.295667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 14:50:03.295667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 14:50:03.295667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:50:03.295667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:50:03.295667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 14:50:03.295667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 14:50:03.295667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 14:50:03.295667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:03.295667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 14:50:03.295667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 14:50:03.295667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 14:50:03.295667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Jun 16 14:50:03.295667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:03.295667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Jun 16 14:50:03.295667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:03.295667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:03.295667 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:03.297560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:03.297560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:03.297560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:03.297560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:03.297560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 14:50:03.297560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:50:03.297560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 14:50:03.297560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Jun 16 14:50:03.297560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:03.297560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Jun 16 14:50:03.297560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:03.297560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:03.297560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:03.297560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:50:03.297560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:50:03.297560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 14:50:03.297560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Jun 16 14:50:03.297560 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-289d14af-319f-4a4f-9e0b-f804b05436c8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:03.299837 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-289d14af-319f-4a4f-9e0b-f804b05436c8 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.086968 Jun 16 14:50:03.299837 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 23/44] 10.222.0.72 () {60 vars in 1190 bytes} [Thu Jun 16 14:50:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 16 14:50:03.304818 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-754980fd-de1b-4254-afe4-19414bffe989 admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:03.320614 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-754980fd-de1b-4254-afe4-19414bffe989 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019478 Jun 16 14:50:03.321236 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 22/45] 10.222.0.72 () {60 vars in 1210 bytes} [Thu Jun 16 14:50:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:03.332549 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-fc444d0e-4a8d-42e4-8210-1bcd2a94315f admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:03.347950 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-fc444d0e-4a8d-42e4-8210-1bcd2a94315f admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019242 Jun 16 14:50:03.348639 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 24/46] 10.222.0.72 () {60 vars in 1210 bytes} [Thu Jun 16 14:50:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:50:03.361798 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-97ab1dd1-48cb-4985-985a-f6519c164718 admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:03.368829 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.wsgi [None req-97ab1dd1-48cb-4985-985a-f6519c164718 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-97ab1dd1-48cb-4985-985a-f6519c164718 admin admin] Request method failure captured: Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Accept: application/json Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Accept-Encoding: gzip, deflate Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Connection: keep-alive Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Content-Length: 0 Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Host: 10.222.0.72 Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Openstack-Api-Version: compute 2.90 Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Openstack-System-Scope: None Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: User-Agent: python-novaclient Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Auth-Token: gAAAAABiq0MbIbP-W3ADlDusMziiGrkTzxuG2JUMsVkQaVgJ8PQzJ0qvh06yBffIfEww2EGdYgD8v3tqIyfbzEK6Jqn1DF7nwH6G5zEzN5A6dO_IVlKzJu8a_thHD14UauUcjUewn-qbaGEiFY-TTGxLeKVHVBQ1j7s90lPwGKp8n9TY_WLHqxY Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Domain-Id: None Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Domain-Name: None Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Identity-Status: Confirmed Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Is-Admin-Project: True Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Project-Domain-Id: default Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Project-Domain-Name: Default Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Project-Id: 1304e58d14b64959b1e4ffc146293183 Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Project-Name: admin Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Role: member,admin,reader Jun 16 14:50:03.370457 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Roles: member,admin,reader Jun 16 14:50:03.371980 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1304e58d14b64959b1e4ffc146293183", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1304e58d14b64959b1e4ffc146293183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1304e58d14b64959b1e4ffc146293183"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1304e58d14b64959b1e4ffc146293183"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:50:03.371980 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Tenant: admin Jun 16 14:50:03.371980 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Tenant-Id: 1304e58d14b64959b1e4ffc146293183 Jun 16 14:50:03.371980 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Tenant-Name: admin Jun 16 14:50:03.371980 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-User: admin Jun 16 14:50:03.371980 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-User-Domain-Id: default Jun 16 14:50:03.371980 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-User-Domain-Name: Default Jun 16 14:50:03.371980 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-User-Id: b8adc1b6aec146cdaed3b9ac9a211c0a Jun 16 14:50:03.371980 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-User-Name: admin Jun 16 14:50:03.371980 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: method: > Jun 16 14:50:03.371980 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: exception: Flavor 84 could not be found. Jun 16 14:50:03.371980 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: action_args: {'id': '84'} Jun 16 14:50:03.371980 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:03.371980 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:03.372795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 14:50:03.372795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 14:50:03.372795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 14:50:03.372795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 14:50:03.372795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:50:03.372795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:50:03.372795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 14:50:03.372795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 14:50:03.372795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 14:50:03.372795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:03.372795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 14:50:03.372795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 14:50:03.372795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 14:50:03.372795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Jun 16 14:50:03.372795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:03.372795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Jun 16 14:50:03.372795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:03.372795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:03.372795 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:03.374095 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:03.374095 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:03.374095 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:03.374095 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:03.374095 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 14:50:03.374095 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:50:03.374095 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 14:50:03.374095 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Jun 16 14:50:03.374095 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:03.374095 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Jun 16 14:50:03.374095 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:03.374095 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:03.374095 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:03.374095 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:50:03.374095 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:50:03.374095 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 14:50:03.374095 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Jun 16 14:50:03.374095 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-97ab1dd1-48cb-4985-985a-f6519c164718 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:03.375306 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-97ab1dd1-48cb-4985-985a-f6519c164718 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.015777 Jun 16 14:50:03.375306 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 23/47] 10.222.0.72 () {60 vars in 1190 bytes} [Thu Jun 16 14:50:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:04.331239 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-fc444d0e-4a8d-42e4-8210-1bcd2a94315f admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:04.332300 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-fc444d0e-4a8d-42e4-8210-1bcd2a94315f admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jun 16 14:50:04.332742 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 25/48] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Jun 16 14:50:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:50:04.567927 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-53764dd0-5082-465e-a0bc-1bc7ae775ff2 admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:04.577646 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.wsgi [None req-53764dd0-5082-465e-a0bc-1bc7ae775ff2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-53764dd0-5082-465e-a0bc-1bc7ae775ff2 admin admin] Request method failure captured: Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Accept: application/json Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Accept-Encoding: gzip, deflate Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Connection: keep-alive Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Content-Length: 0 Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Host: 10.222.0.72 Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Openstack-Api-Version: compute 2.90 Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Openstack-System-Scope: None Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: User-Agent: python-novaclient Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Auth-Token: gAAAAABiq0McL10T0LCJ4FYnuxKt66ZAa5fFPLejPCodcqmQg5rpOT45q8jS0qDpPrd99qJK1_Qh2QMPewQqpxAH9-DI-0Z55lQ_9kdgVYbFGs-Tr94zhLfK8nzsd7X33pATxeCFibP3yYgVYt1ywbtWGcP5PtuNaHapOpw_tQI_PG4V5ebhqkw Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Domain-Id: None Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Domain-Name: None Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Identity-Status: Confirmed Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Is-Admin-Project: True Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Project-Domain-Id: default Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Project-Domain-Name: Default Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Project-Id: 1304e58d14b64959b1e4ffc146293183 Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Project-Name: admin Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Role: member,admin,reader Jun 16 14:50:04.579222 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Roles: member,admin,reader Jun 16 14:50:04.581666 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1304e58d14b64959b1e4ffc146293183", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1304e58d14b64959b1e4ffc146293183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1304e58d14b64959b1e4ffc146293183"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1304e58d14b64959b1e4ffc146293183"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:50:04.581666 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Tenant: admin Jun 16 14:50:04.581666 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Tenant-Id: 1304e58d14b64959b1e4ffc146293183 Jun 16 14:50:04.581666 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-Tenant-Name: admin Jun 16 14:50:04.581666 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-User: admin Jun 16 14:50:04.581666 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-User-Domain-Id: default Jun 16 14:50:04.581666 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-User-Domain-Name: Default Jun 16 14:50:04.581666 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-User-Id: b8adc1b6aec146cdaed3b9ac9a211c0a Jun 16 14:50:04.581666 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: X-User-Name: admin Jun 16 14:50:04.581666 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: method: > Jun 16 14:50:04.581666 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: exception: Flavor 451 could not be found. Jun 16 14:50:04.581666 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: action_args: {'id': '451'} Jun 16 14:50:04.581666 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:04.581666 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:04.583802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 14:50:04.583802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 14:50:04.583802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 14:50:04.583802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 14:50:04.583802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:50:04.583802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:50:04.583802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 14:50:04.583802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 14:50:04.583802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 14:50:04.583802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:04.583802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 14:50:04.583802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 14:50:04.583802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 14:50:04.583802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Jun 16 14:50:04.583802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:04.583802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Jun 16 14:50:04.583802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:04.583802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:04.583802 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:04.586044 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:04.586044 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:04.586044 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:04.586044 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:04.586044 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 14:50:04.586044 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:50:04.586044 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 14:50:04.586044 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Jun 16 14:50:04.586044 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:04.586044 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Jun 16 14:50:04.586044 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:04.586044 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:04.586044 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:04.586044 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:50:04.586044 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:50:04.586044 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 14:50:04.586044 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: ERROR nova.api.openstack.wsgi Jun 16 14:50:04.586044 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-53764dd0-5082-465e-a0bc-1bc7ae775ff2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:04.588302 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-53764dd0-5082-465e-a0bc-1bc7ae775ff2 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.097598 Jun 16 14:50:04.588302 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 24/49] 10.222.0.72 () {60 vars in 1193 bytes} [Thu Jun 16 14:50:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:04.594277 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-f0f8f7de-0739-4d1b-9790-dcad981da52f admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:04.610185 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-f0f8f7de-0739-4d1b-9790-dcad981da52f admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019418 Jun 16 14:50:04.610783 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 26/50] 10.222.0.72 () {60 vars in 1210 bytes} [Thu Jun 16 14:50:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:04.621470 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-d5f5a5f3-01f6-49d8-9c6d-20205a49acea admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:04.636484 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-d5f5a5f3-01f6-49d8-9c6d-20205a49acea admin admin] 10.222.0.72 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018523 Jun 16 14:50:04.637101 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 25/51] 10.222.0.72 () {60 vars in 1210 bytes} [Thu Jun 16 14:50:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:50:04.651049 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-44e0406b-d7bd-4334-9867-e21c074bed3c admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:04.661843 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.wsgi [None req-44e0406b-d7bd-4334-9867-e21c074bed3c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-44e0406b-d7bd-4334-9867-e21c074bed3c admin admin] Request method failure captured: Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Accept: application/json Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Accept-Encoding: gzip, deflate Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Connection: keep-alive Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Content-Length: 0 Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Host: 10.222.0.72 Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Openstack-Api-Version: compute 2.90 Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Openstack-System-Scope: None Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: User-Agent: python-novaclient Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Auth-Token: gAAAAABiq0McL10T0LCJ4FYnuxKt66ZAa5fFPLejPCodcqmQg5rpOT45q8jS0qDpPrd99qJK1_Qh2QMPewQqpxAH9-DI-0Z55lQ_9kdgVYbFGs-Tr94zhLfK8nzsd7X33pATxeCFibP3yYgVYt1ywbtWGcP5PtuNaHapOpw_tQI_PG4V5ebhqkw Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Domain-Id: None Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Domain-Name: None Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Identity-Status: Confirmed Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Is-Admin-Project: True Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Project-Domain-Id: default Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Project-Domain-Name: Default Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Project-Id: 1304e58d14b64959b1e4ffc146293183 Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Project-Name: admin Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Role: member,admin,reader Jun 16 14:50:04.664725 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Roles: member,admin,reader Jun 16 14:50:04.666219 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1304e58d14b64959b1e4ffc146293183", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1304e58d14b64959b1e4ffc146293183"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1304e58d14b64959b1e4ffc146293183"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1304e58d14b64959b1e4ffc146293183"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:50:04.666219 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Tenant: admin Jun 16 14:50:04.666219 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Tenant-Id: 1304e58d14b64959b1e4ffc146293183 Jun 16 14:50:04.666219 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-Tenant-Name: admin Jun 16 14:50:04.666219 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-User: admin Jun 16 14:50:04.666219 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-User-Domain-Id: default Jun 16 14:50:04.666219 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-User-Domain-Name: Default Jun 16 14:50:04.666219 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-User-Id: b8adc1b6aec146cdaed3b9ac9a211c0a Jun 16 14:50:04.666219 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: X-User-Name: admin Jun 16 14:50:04.666219 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: method: > Jun 16 14:50:04.666219 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: exception: Flavor 451 could not be found. Jun 16 14:50:04.666219 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: action_args: {'id': '451'} Jun 16 14:50:04.666219 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:50:04.666219 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:04.667060 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 14:50:04.667060 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 14:50:04.667060 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 14:50:04.667060 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 14:50:04.667060 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 14:50:04.667060 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 14:50:04.667060 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 14:50:04.667060 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 14:50:04.667060 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 14:50:04.667060 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:04.667060 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 14:50:04.667060 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 14:50:04.667060 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 14:50:04.667060 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Jun 16 14:50:04.667060 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:04.667060 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Jun 16 14:50:04.667060 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:04.667060 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:04.667060 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:04.668119 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:50:04.668119 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:50:04.668119 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:50:04.668119 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:50:04.668119 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 14:50:04.668119 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:50:04.668119 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 14:50:04.668119 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Jun 16 14:50:04.668119 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:50:04.668119 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Jun 16 14:50:04.668119 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:50:04.668119 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:50:04.668119 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:50:04.668119 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:50:04.668119 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:50:04.668119 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 14:50:04.668119 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: ERROR nova.api.openstack.wsgi Jun 16 14:50:04.668119 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-44e0406b-d7bd-4334-9867-e21c074bed3c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:50:04.669333 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-44e0406b-d7bd-4334-9867-e21c074bed3c admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.023329 Jun 16 14:50:04.669333 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 27/52] 10.222.0.72 () {60 vars in 1193 bytes} [Thu Jun 16 14:50:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 14:50:06.186808 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-d5f5a5f3-01f6-49d8-9c6d-20205a49acea admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:06.188280 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-d5f5a5f3-01f6-49d8-9c6d-20205a49acea admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002103 Jun 16 14:50:06.188824 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 26/53] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Jun 16 14:50:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:50:06.402480 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-533a93c7-62fa-41c8-b76e-bc46809fff7c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:06.425850 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-533a93c7-62fa-41c8-b76e-bc46809fff7c admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.083040 Jun 16 14:50:06.426893 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 28/54] 10.222.0.72 () {64 vars in 1235 bytes} [Thu Jun 16 14:50:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:50:07.382903 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-d5f5a5f3-01f6-49d8-9c6d-20205a49acea admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:07.383940 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-d5f5a5f3-01f6-49d8-9c6d-20205a49acea admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jun 16 14:50:07.384351 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 27/55] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Jun 16 14:50:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:50:07.592924 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-0500bbf0-7ee8-477f-971e-790a31147082 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:07.617972 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-0500bbf0-7ee8-477f-971e-790a31147082 admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.086348 Jun 16 14:50:07.618534 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 29/56] 10.222.0.72 () {64 vars in 1235 bytes} [Thu Jun 16 14:50:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:50:08.765074 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-d5f5a5f3-01f6-49d8-9c6d-20205a49acea admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:08.766431 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-d5f5a5f3-01f6-49d8-9c6d-20205a49acea admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001838 Jun 16 14:50:08.766948 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 28/57] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Jun 16 14:50:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:50:08.979480 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-887669b9-761a-4956-a326-17d88fe7f52b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:09.000114 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-887669b9-761a-4956-a326-17d88fe7f52b admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.084651 Jun 16 14:50:09.000691 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 30/58] 10.222.0.72 () {64 vars in 1235 bytes} [Thu Jun 16 14:50:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 14:50:09.940660 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-d5f5a5f3-01f6-49d8-9c6d-20205a49acea admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:09.941781 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-d5f5a5f3-01f6-49d8-9c6d-20205a49acea admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Jun 16 14:50:09.942910 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 29/59] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Jun 16 14:50:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:50:10.172473 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-893e0806-fe8f-4a51-8acc-d2bd6bbfd7ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:50:10.200774 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-893e0806-fe8f-4a51-8acc-d2bd6bbfd7ae admin admin] 10.222.0.72 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.100462 Jun 16 14:50:10.201605 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 31/60] 10.222.0.72 () {64 vars in 1235 bytes} [Thu Jun 16 14:50:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 14:50:11.376335 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-d5f5a5f3-01f6-49d8-9c6d-20205a49acea admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:11.377411 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-d5f5a5f3-01f6-49d8-9c6d-20205a49acea admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jun 16 14:50:11.377831 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 30/61] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Jun 16 14:50:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:50:11.707866 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-72f17244-f6bb-4a0c-b5ad-cc1538455bf4 admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:50:11.730017 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-72f17244-f6bb-4a0c-b5ad-cc1538455bf4 admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.081251 Jun 16 14:50:11.730795 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 32/62] 10.222.0.72 () {60 vars in 1202 bytes} [Thu Jun 16 14:50:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:08.588878 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-d5f5a5f3-01f6-49d8-9c6d-20205a49acea admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:08.589964 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-d5f5a5f3-01f6-49d8-9c6d-20205a49acea admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Jun 16 14:51:08.590387 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 31/63] 10.222.0.72 () {54 vars in 930 bytes} [Thu Jun 16 14:51:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:51:08.605531 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG dbcounter [-] [109740] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:08.676253 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-042f40f2-aec1-463a-bd87-5de53c1c85fa admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:08.698375 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-042f40f2-aec1-463a-bd87-5de53c1c85fa admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.097491 Jun 16 14:51:08.698946 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 33/64] 10.222.0.72 () {60 vars in 1291 bytes} [Thu Jun 16 14:51:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:51:08.736221 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG dbcounter [-] [109739] Writing DB stats nova_api:SELECT=14 {{(pid=109739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:51:08.740748 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-ac938ae3-f8e9-490b-8012-885c45b1113e admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:08.753632 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-ac938ae3-f8e9-490b-8012-885c45b1113e admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018188 Jun 16 14:51:08.754624 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 32/65] 10.222.0.72 () {60 vars in 1282 bytes} [Thu Jun 16 14:51:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:51:08.774506 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-4c005ae0-1462-49ad-9e89-d758b3c7544f admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:08.783321 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-4c005ae0-1462-49ad-9e89-d758b3c7544f admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013509 Jun 16 14:51:08.783903 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 34/66] 10.222.0.72 () {60 vars in 1285 bytes} [Thu Jun 16 14:51:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:51:08.796686 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-909dcd38-8483-4165-a4d3-31d7ba05c8bd admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:08.805402 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-909dcd38-8483-4165-a4d3-31d7ba05c8bd admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012547 Jun 16 14:51:08.806120 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 33/67] 10.222.0.72 () {60 vars in 1285 bytes} [Thu Jun 16 14:51:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:51:08.821437 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-dcd7be15-e957-4be5-b435-1fdf7c14d5ac admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:51:08.831547 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-dcd7be15-e957-4be5-b435-1fdf7c14d5ac admin admin] 10.222.0.72 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013366 Jun 16 14:51:08.832293 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 35/68] 10.222.0.72 () {60 vars in 1282 bytes} [Thu Jun 16 14:51:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:55:01.663646 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-909dcd38-8483-4165-a4d3-31d7ba05c8bd admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:01.664882 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-909dcd38-8483-4165-a4d3-31d7ba05c8bd admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001667 Jun 16 14:55:01.665300 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 34/69] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Jun 16 14:55:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:01.826864 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG dbcounter [-] [109740] Writing DB stats nova_api:SELECT=6 {{(pid=109740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:01.942775 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-26748978-fd0c-4cd0-831a-cb10bdd0a812 admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:01.943942 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:55:01.943942 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: warnings.warn(msg) Jun 16 14:55:01.945216 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-26748978-fd0c-4cd0-831a-cb10bdd0a812 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:01.945654 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-26748978-fd0c-4cd0-831a-cb10bdd0a812 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:01.946435 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-26748978-fd0c-4cd0-831a-cb10bdd0a812 admin admin] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:01.946879 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-26748978-fd0c-4cd0-831a-cb10bdd0a812 admin admin] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:01.981212 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-26748978-fd0c-4cd0-831a-cb10bdd0a812 admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155786 Jun 16 14:55:01.982366 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 36/70] 10.222.0.72 () {60 vars in 1193 bytes} [Thu Jun 16 14:55:01 2022] GET /compute/v2.1/os-services => generated 791 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:55:02.861383 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-909dcd38-8483-4165-a4d3-31d7ba05c8bd admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:02.862391 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-909dcd38-8483-4165-a4d3-31d7ba05c8bd admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jun 16 14:55:02.862786 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 35/71] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Jun 16 14:55:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:03.056673 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-09192fad-6ccc-4077-9c54-edfc711ed947 admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:03.057872 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:55:03.057872 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: warnings.warn(msg) Jun 16 14:55:03.059081 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-09192fad-6ccc-4077-9c54-edfc711ed947 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:03.059515 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-09192fad-6ccc-4077-9c54-edfc711ed947 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:03.060894 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-09192fad-6ccc-4077-9c54-edfc711ed947 admin admin] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:03.061325 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-09192fad-6ccc-4077-9c54-edfc711ed947 admin admin] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:03.081359 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-09192fad-6ccc-4077-9c54-edfc711ed947 admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077505 Jun 16 14:55:03.081851 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 37/72] 10.222.0.72 () {60 vars in 1193 bytes} [Thu Jun 16 14:55:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 14:55:14.496873 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-909dcd38-8483-4165-a4d3-31d7ba05c8bd admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:14.499099 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-909dcd38-8483-4165-a4d3-31d7ba05c8bd admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002670 Jun 16 14:55:14.499505 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 36/73] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Jun 16 14:55:14 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:14.647534 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG dbcounter [-] [109740] Writing DB stats nova_cell0:SELECT=4 {{(pid=109740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:14.648255 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG dbcounter [-] [109740] Writing DB stats nova_cell1:SELECT=4 {{(pid=109740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:14.649079 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG dbcounter [-] [109740] Writing DB stats nova_api:SELECT=8 {{(pid=109740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:55:14.718912 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-7bac630b-4ce0-4dba-b445-5cbe6f52a0b2 admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:14.720102 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:55:14.720102 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: warnings.warn(msg) Jun 16 14:55:14.721340 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-7bac630b-4ce0-4dba-b445-5cbe6f52a0b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:14.721786 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-7bac630b-4ce0-4dba-b445-5cbe6f52a0b2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:14.722585 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-7bac630b-4ce0-4dba-b445-5cbe6f52a0b2 admin admin] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:14.723023 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-7bac630b-4ce0-4dba-b445-5cbe6f52a0b2 admin admin] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:14.753576 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-7bac630b-4ce0-4dba-b445-5cbe6f52a0b2 admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.110261 Jun 16 14:55:14.754173 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 38/74] 10.222.0.72 () {60 vars in 1193 bytes} [Thu Jun 16 14:55:14 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:55:15.663609 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: DEBUG nova.api.openstack.wsgi [None req-909dcd38-8483-4165-a4d3-31d7ba05c8bd admin admin] Calling method '>' {{(pid=109739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:15.665036 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: INFO nova.api.openstack.requestlog [None req-909dcd38-8483-4165-a4d3-31d7ba05c8bd admin admin] 10.222.0.72 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001740 Jun 16 14:55:15.665629 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: [pid: 109739|app: 0|req: 37/75] 10.222.0.72 () {56 vars in 1074 bytes} [Thu Jun 16 14:55:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:55:15.862200 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG nova.api.openstack.wsgi [None req-624d0172-5fbf-407d-8ab5-6af6abd1ad76 admin admin] Calling method '>' {{(pid=109740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:55:15.863491 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 14:55:15.863491 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: warnings.warn(msg) Jun 16 14:55:15.864662 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-624d0172-5fbf-407d-8ab5-6af6abd1ad76 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:15.865158 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-624d0172-5fbf-407d-8ab5-6af6abd1ad76 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:15.866026 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-624d0172-5fbf-407d-8ab5-6af6abd1ad76 admin admin] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:55:15.866448 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: DEBUG oslo_concurrency.lockutils [None req-624d0172-5fbf-407d-8ab5-6af6abd1ad76 admin admin] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:55:15.890477 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: INFO nova.api.openstack.requestlog [None req-624d0172-5fbf-407d-8ab5-6af6abd1ad76 admin admin] 10.222.0.72 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081918 Jun 16 14:55:15.891051 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: [pid: 109740|app: 0|req: 39/76] 10.222.0.72 () {60 vars in 1193 bytes} [Thu Jun 16 14:55:15 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:56:16.483988 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: Thu Jun 16 14:56:16 2022 - graceful shutdown triggered... Jun 16 14:56:16.484045 dv-cinder-837165-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 14:56:16.485022 dv-cinder-837165-3-iscsi devstack@n-api.service[109739]: Gracefully killing worker 1 (pid: 109739)... Jun 16 14:56:16.485445 dv-cinder-837165-3-iscsi devstack@n-api.service[109740]: Gracefully killing worker 2 (pid: 109740)... Jun 16 14:56:17.485081 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: worker 1 buried after 1 seconds Jun 16 14:56:17.485671 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: worker 2 buried after 1 seconds Jun 16 14:56:17.485671 dv-cinder-837165-3-iscsi devstack@n-api.service[109738]: goodbye to uWSGI. Jun 16 14:56:17.486893 dv-cinder-837165-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 14:56:17.487463 dv-cinder-837165-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 14:56:17.490352 dv-cinder-837165-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 14:56:17.503172 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 14:56:17.506276 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 14:56:17 2022] *** Jun 16 14:56:17.506276 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 14:56:17.506276 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 14:56:17.506276 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: nodename: dv-cinder-837165-3-iscsi Jun 16 14:56:17.506276 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: machine: x86_64 Jun 16 14:56:17.506276 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: clock source: unix Jun 16 14:56:17.506276 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: pcre jit disabled Jun 16 14:56:17.506276 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: detected number of CPU cores: 4 Jun 16 14:56:17.506276 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: current working directory: / Jun 16 14:56:17.506276 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: detected binary path: /usr/bin/uwsgi-core Jun 16 14:56:17.506276 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: your processes number limit is 47680 Jun 16 14:56:17.506276 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: your memory page size is 4096 bytes Jun 16 14:56:17.507261 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: detected max file descriptor number: 2048 Jun 16 14:56:17.507261 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: lock engine: pthread robust mutexes Jun 16 14:56:17.507261 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: thunder lock: enabled Jun 16 14:56:17.507261 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 14:56:17.507261 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 14:56:17.553138 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: Python main interpreter initialized at 0x5603d27959c0 Jun 16 14:56:17.553138 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: python threads support enabled Jun 16 14:56:17.553138 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: your server socket listen backlog is limited to 100 connections Jun 16 14:56:17.553138 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: your mercy for graceful operations on workers is 90 seconds Jun 16 14:56:17.553611 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 14:56:17.553611 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: *** Operational MODE: preforking *** Jun 16 14:56:17.553896 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: *** uWSGI is running in multiple interpreter mode *** Jun 16 14:56:17.553896 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: spawned uWSGI master process (pid: 124575) Jun 16 14:56:17.554107 dv-cinder-837165-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 14:56:17.554838 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: spawned uWSGI worker 1 (pid: 124589, cores: 1) Jun 16 14:56:17.556978 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: spawned uWSGI worker 2 (pid: 124590, cores: 1) Jun 16 14:56:17.556978 dv-cinder-837165-3-iscsi devstack@n-api.service[124575]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 14:56:18.224170 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 14:56:18.239692 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 14:56:19.537812 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:56:19.537812 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: from cryptography.utils import int_from_bytes Jun 16 14:56:19.538568 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:56:19.538568 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: from cryptography.utils import int_from_bytes Jun 16 14:56:19.967315 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:56:19.967315 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: from cryptography.utils import int_from_bytes Jun 16 14:56:19.967946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 14:56:19.967946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: from cryptography.utils import int_from_bytes Jun 16 14:56:21.996890 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 14:56:21.997476 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 14:56:21.997824 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 14:56:21.997990 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 14:56:21.998257 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 14:56:21.998644 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:21.999067 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:21.999400 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:21.999730 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.000078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.000400 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.000814 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.001214 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.001519 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.001790 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.002114 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.002452 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837165-3-iscsi {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.002810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.003192 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.003515 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.003846 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.004161 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.004494 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.007488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.007488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.007488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.007956 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.008502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.009214 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.009650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.009981 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.010320 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.010637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.010979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.011300 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.011723 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837165-3-iscsi {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.012612 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.012990 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.013302 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.013738 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.014068 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.014383 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.014716 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.015053 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.015385 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.015873 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.016276 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.016603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.016959 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.017274 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.017596 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.017919 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.018495 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.018664 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.018881 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.019125 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.019446 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.019776 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.020110 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.020442 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.020702 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.021000 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.022067 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.022067 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.022067 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.022310 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.022559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.024933 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.024933 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.024933 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.024933 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.024933 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.024933 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.024933 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.025543 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.025543 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.026118 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.026426 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.026684 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.027000 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.027362 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.027721 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.028097 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.028479 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.028817 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.029085 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.029417 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.029710 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.030042 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.030403 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.030714 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.030968 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.031280 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.031595 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.031924 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.032236 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.032552 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.033011 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.033323 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.033573 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.033804 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.034116 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.034428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.034761 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.035067 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.035376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.035689 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.036002 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.036341 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.036669 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.037020 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.037326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.037641 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.037947 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.038274 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.038607 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.038998 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.039354 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.039672 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.039977 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.040297 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.040795 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.041272 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.041706 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.042025 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.042393 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.042956 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.043352 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.043673 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.043991 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.044315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.044630 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.044970 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.045286 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.045602 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.045911 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.046249 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.046590 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.046905 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.047219 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.047690 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.047911 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.048186 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.048527 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.048912 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.049375 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.049578 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.049921 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.050250 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.050633 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.051874 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.051874 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.051874 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.051874 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.052552 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.052552 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.052875 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.053120 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.053446 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.053772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.054099 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.054419 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.054745 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.055081 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.055412 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.055732 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.056083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.056439 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.056768 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.057124 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.057465 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.057783 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.058094 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.059469 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.059469 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.059702 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.059928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.060872 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.060872 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.060872 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.061312 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.061514 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.061881 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.062186 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.062513 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.062872 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.063138 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.063457 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.063784 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.064092 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.064397 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.064709 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.065162 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.065359 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.065665 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.065973 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.066301 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.066639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.066951 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.067290 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.067602 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.067921 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.068240 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.068551 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.068894 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.069210 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.069570 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.069840 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.070175 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.070501 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.070813 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.071137 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.071450 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.071761 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.072082 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.072422 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.072718 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.073053 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.073373 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.073782 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.074177 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.074336 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.075324 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.075579 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.076052 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.076382 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.076722 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.077072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.077386 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.077706 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.078017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.078331 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.078644 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.079066 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.079277 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.079591 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.079904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.080220 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.080528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.080892 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.081215 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.081526 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.081836 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.082265 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.082469 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.082859 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.083136 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.083483 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.083824 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.084372 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.084545 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.084765 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.085110 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.085512 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.085738 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.086149 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.086532 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.086704 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.087008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.087331 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.087756 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.088029 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.088268 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.088570 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.088988 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.089268 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.089611 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.089942 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.090356 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.090611 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.090933 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.091251 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.091571 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.091884 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.092203 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.092528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.093217 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.093217 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.093549 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.094796 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.094796 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.094796 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.094796 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.095415 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.095415 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.095971 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.096114 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.096304 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.096724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.097136 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.097310 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.097578 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.097894 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.098205 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.098522 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.098845 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.099168 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.099483 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.099791 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.100114 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.100531 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.100731 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.101087 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.101408 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.101750 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.102060 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.102390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.102748 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.103030 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.103349 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.103662 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.103977 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.104286 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.104597 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.105116 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.105268 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.105577 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.106030 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.106234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.106568 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.106908 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.107206 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.107500 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.107813 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.108142 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.108477 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.108773 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.109317 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.109493 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.109783 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.110074 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.110406 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.110724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.111038 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.111353 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.111662 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.111985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.112304 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.112915 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.113258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.113582 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.113902 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.114226 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.115384 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.115384 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.115384 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.115812 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.115812 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.116355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.116514 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.117017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.117341 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.117583 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.117731 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.118029 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.118796 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.118796 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.119112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.119255 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.119550 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.119867 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.120177 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.120497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.120879 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.121168 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.122025 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.122336 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.122647 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.122958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.123312 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.123682 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.124074 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.124305 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.124659 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.124993 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.125497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.125666 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.125934 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.126247 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.126615 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.127011 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.127185 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.127496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.127888 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.128100 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.128401 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.128716 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.129048 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.129363 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.129768 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.129975 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.130286 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.130599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.130909 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.131335 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.131659 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.131853 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.132220 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.132474 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.132796 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.133567 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.133567 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.133771 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.134024 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.134336 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.134648 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.135005 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.135307 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.135631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.135930 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.136247 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.136559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.136907 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.137763 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.138094 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.138420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.138730 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.139047 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.139357 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.139676 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.139985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.140296 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.140604 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.140937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.141251 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.141561 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.141871 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.142209 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.142522 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.142832 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.143146 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.143450 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.143806 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.144116 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.144484 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.144795 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.145151 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.145477 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.145798 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.146272 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.146531 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.146748 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.147070 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.147381 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.147697 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.148244 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.148346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.148631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.148972 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.149290 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.149626 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.149958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.150290 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.150868 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.151183 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.151499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.151814 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.152141 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.152474 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.152821 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.153167 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.153480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.153815 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.154130 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.154444 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.154747 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.155063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.155369 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.155705 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.156021 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.156452 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.156696 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.156991 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.157287 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.157597 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.158112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.159686 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.159686 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.159686 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.159686 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.159686 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.160229 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.160229 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.160482 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.160945 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.161263 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.161575 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.161890 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.162212 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.162501 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.162820 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.163165 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.163510 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.163781 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.164090 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.164421 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.164731 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.165087 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.165524 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.165838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.166146 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.166573 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.166891 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.167206 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.167534 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.167860 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.168213 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.168525 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.168868 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.169184 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.169521 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.169859 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.170206 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.170497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.170810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.171136 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.171508 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.171783 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.172115 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.172545 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.172896 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.173215 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.173919 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.173919 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.175808 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.175808 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.175808 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.175808 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.175808 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.175808 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.176496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.176496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.176712 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.177167 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.177345 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.177501 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.177825 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.178138 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.178467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.178787 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.179112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.179568 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.179739 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.180071 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.180385 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.180694 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.181040 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.181349 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.181701 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.182015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.182344 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.182679 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.183014 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.183331 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.183672 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.184551 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.184890 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.185221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.185554 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.185862 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.186173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.186491 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.192096 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.192096 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.192096 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.192096 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.192096 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.192096 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.192096 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.192096 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.193447 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.193447 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.193447 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.193447 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.193447 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.193447 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.193447 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.193447 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.194471 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.194471 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.194471 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.194471 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.194471 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.194471 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.194471 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.194471 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.195478 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.195478 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.195478 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.195478 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.196097 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.196097 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.196375 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.196585 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.199019 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.199019 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.199019 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.199019 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.199019 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.199019 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.200629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.200629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.200629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.200999 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.201125 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.201723 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.201723 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.202013 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.202352 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.202773 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.203028 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.203353 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.203675 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.203997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.204366 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.204689 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.205035 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.205371 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.205695 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.206013 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.206329 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.206646 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.206964 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.207290 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.207608 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.207924 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.208234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.208554 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.208912 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.209256 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.209590 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.209908 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.210229 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.210551 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.211124 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.211447 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.211867 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.212116 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.212450 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.212772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.213126 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.213466 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.213773 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.214185 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.214403 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.214905 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.215256 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.215589 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.215908 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.216219 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.216545 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.216877 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.217442 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.217799 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.218129 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.218461 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.218792 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.219120 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.219496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.219916 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.220399 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.220718 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.221073 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.221394 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.221702 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.222191 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.222300 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.222614 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.222921 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.223237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.223550 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.223878 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.224190 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.224500 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.224808 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.225149 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.225462 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.225774 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.226091 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.226399 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.226717 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.227028 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.227343 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.227660 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.227975 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.228433 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.228599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.228992 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.229332 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.229651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.229965 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.230291 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.231169 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.231488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.231809 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.232126 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.232492 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.232816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.233800 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.234089 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.234423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.234777 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.235126 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.235443 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.235768 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.236073 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.236425 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.236708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.237053 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.237373 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.237693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.238009 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.238359 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.238771 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.239345 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.239809 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.240134 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.240429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.240761 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.241189 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.241516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.241882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.242295 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.242567 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.242939 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.243266 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.243586 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.243904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.244317 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.244670 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.245024 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.245367 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.245693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.246019 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.246593 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.246865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.247238 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.247517 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.247838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.248167 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.248497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.248815 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.249177 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.249499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.249837 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.250193 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.250529 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.250860 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.251175 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.251485 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.251795 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.252109 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.252474 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.252747 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.253082 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.253393 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.253709 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.254021 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.254329 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.254640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.254948 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.255259 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.255567 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.255875 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.256183 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.256489 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.256797 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.257130 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.257442 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.257753 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.258065 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.258374 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.258686 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.258996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.259347 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.259692 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.260016 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.260349 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.260668 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.261023 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.261343 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.261673 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.262636 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.262878 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.263196 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.263535 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.263858 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.264195 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.264479 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.264797 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.265169 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.265445 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.265788 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.266122 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.266439 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.266774 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.267098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.267428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.267750 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.268067 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.268405 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.268774 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.269051 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.269371 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.269687 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.270012 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.270336 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.270657 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.270994 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.271328 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.271646 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.271979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.272316 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.272789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.273032 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.273429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.273728 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.274049 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.274366 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.274681 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.274929 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 14:56:22.340431 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO dbcounter [None req-af2cee61-1dbe-4421-abd4-97c69ec5e187 None None] Registered counter for database nova_api Jun 16 14:56:22.362414 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_db.sqlalchemy.engines [None req-af2cee61-1dbe-4421-abd4-97c69ec5e187 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:56:22.370783 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writer thread running {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:56:22.436198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.context [None req-af2cee61-1dbe-4421-abd4-97c69ec5e187 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5bf84c3a-2cb0-4224-8719-767e2c0696c7(cell1) {{(pid=124590) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 14:56:22.440393 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-af2cee61-1dbe-4421-abd4-97c69ec5e187 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:22.442063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-af2cee61-1dbe-4421-abd4-97c69ec5e187 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:22.442887 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-af2cee61-1dbe-4421-abd4-97c69ec5e187 None None] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:22.444898 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-af2cee61-1dbe-4421-abd4-97c69ec5e187 None None] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:22.446976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO dbcounter [None req-af2cee61-1dbe-4421-abd4-97c69ec5e187 None None] Registered counter for database nova_cell0 Jun 16 14:56:22.452896 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO dbcounter [None req-af2cee61-1dbe-4421-abd4-97c69ec5e187 None None] Registered counter for database nova_cell1 Jun 16 14:56:22.454583 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 14:56:22.455054 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 14:56:22.455775 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 14:56:22.456008 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 14:56:22.456106 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 14:56:22.456562 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.456883 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.457171 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.457492 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.457941 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.458140 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.458467 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.458787 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.459119 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.459382 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.459703 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.460024 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837165-3-iscsi {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.460348 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.460659 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.461001 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.461327 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.461635 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.461956 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.462263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.462785 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.462955 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_db.sqlalchemy.engines [None req-af2cee61-1dbe-4421-abd4-97c69ec5e187 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:56:22.463105 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.463387 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.463818 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.464028 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.464339 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.464655 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.466223 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.466223 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.466223 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.466626 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_db.sqlalchemy.engines [None req-af2cee61-1dbe-4421-abd4-97c69ec5e187 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:56:22.466761 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.469131 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837165-3-iscsi {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.469492 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.469828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.470164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.470616 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.470952 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.471271 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.471607 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.471956 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.472272 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.472611 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.472855 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writer thread running {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:56:22.472963 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.473282 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.473614 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.473925 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.474197 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writer thread running {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:56:22.474299 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.474546 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.474863 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.475174 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.475489 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.475739 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.476049 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.476375 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.476706 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.477056 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.477309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.477562 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.477886 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.478211 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.478518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.478827 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.479136 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.479444 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.479749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.480055 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.480363 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.481259 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.481557 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.481875 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.482198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.482508 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.482830 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.483235 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.72 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.483495 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.72 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.483804 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.484149 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.484467 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.484775 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.485124 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.485448 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.485756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.486063 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.486369 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.486692 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.487035 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.487335 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.487699 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.487895 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.488290 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.488525 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.488832 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.489161 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.489472 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.489776 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.490086 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.490393 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.490703 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.491008 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.491334 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.491621 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.491931 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.492239 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.492542 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.492869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.493201 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.493515 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.493821 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.494127 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.494433 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.494752 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.495058 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.495362 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.495757 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.496067 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.496957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.497379 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.497628 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.497935 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.498254 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.498558 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.498863 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.499181 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.499486 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.499792 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.500096 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.500403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.500703 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.501034 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.501338 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.501643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.501947 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.502268 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.502615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.502925 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.503234 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.503543 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.503861 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 14:56:22.504201 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.504533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.504906 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.505222 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.505559 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.505892 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.506209 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.506524 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.506836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.507167 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.507480 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.507791 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.508103 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.508422 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.508743 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.509097 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.509414 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.509740 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.510065 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.510375 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.510694 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.511025 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.511346 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.511657 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.512026 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.512378 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.512693 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.513044 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.513380 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.513694 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.514005 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.514316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.514680 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.514973 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.515285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.515603 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.515919 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.516227 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.516540 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.516876 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.517185 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.517529 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.517840 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.518155 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.518467 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.518784 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.519094 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.519403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.519827 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.520135 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.520544 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.520774 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.521117 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.521455 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.521754 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.522084 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.522459 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.522783 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.523020 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.523338 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.523652 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.523961 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.524266 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.524578 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.524913 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.525220 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.525547 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.526122 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.526428 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.526750 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.527054 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.527358 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.527709 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.528015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.528327 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.528641 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.528975 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.529303 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.529617 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.529928 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.530266 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.530605 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.530909 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.531232 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.531557 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.531874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.532180 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.532494 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.532798 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.533145 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.534455 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.534455 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.534455 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.534455 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.534890 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.535050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.535197 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.535532 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.535847 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.536151 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.536457 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.536761 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.537136 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.537444 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.537790 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.538128 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.538447 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.538773 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.539088 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.539398 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.539705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.540016 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.540326 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.540637 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.541068 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.541392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.541712 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.542027 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.542359 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.542688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.543010 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.543851 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.544170 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.544514 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.544867 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.545192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.545516 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.545828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.546144 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.546506 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.546823 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.547132 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.547441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.547759 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.548076 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.548393 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.548705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.549080 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.549392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.549712 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.550034 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.550355 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.550706 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.551044 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.551355 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.551672 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.551993 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.552306 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.552622 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.552960 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.553271 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.553582 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.553898 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.554212 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.554533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.554833 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.555140 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.555595 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.555932 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.556238 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.556667 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.556878 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.557189 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.557525 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.557853 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.558242 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.558485 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.558876 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.559720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.560034 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.560346 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.560650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.560988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.561337 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.561653 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.561964 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.562284 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.562608 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.562923 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.563245 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.563563 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.563875 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.564199 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.564516 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.564825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.565199 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.565513 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.565823 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.566135 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.566460 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.566772 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.567082 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.567391 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.567694 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.568004 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.568344 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.568928 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.569262 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.569648 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.569943 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.570225 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.570544 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.570876 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.571267 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.571568 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.571879 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.572190 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.572497 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.572804 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.573146 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.573448 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.573759 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.574064 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.574519 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.574832 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.575136 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.575458 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.575768 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.576084 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.576409 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.576724 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.577054 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.577385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.577696 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.577998 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.578302 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.578605 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.578950 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.579255 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.579596 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.579925 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.580268 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.580573 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.580899 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.581228 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.581533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.581936 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.582135 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.582445 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.582754 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.583057 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.583367 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.583712 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.583989 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.584300 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.584597 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.585162 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.585472 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.585790 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.586100 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.586403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.586707 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.587017 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.587324 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.587627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.588009 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.588239 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.588554 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.588893 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.589191 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.589500 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.589811 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.590651 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.590957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.591542 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.591667 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.591994 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.592374 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.592703 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.593044 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.593352 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.593662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.593987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.594312 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.594615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.594928 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.595234 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.595565 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.595872 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.596182 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.596485 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.596789 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.597120 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.597423 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.597726 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.598054 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.598432 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.598804 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.599113 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.599491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.599844 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.600148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.600517 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.600961 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.601258 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.601583 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.601896 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.602206 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.602522 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.602827 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.603144 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.603455 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.603753 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.604060 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.604363 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.604688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.605026 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.605341 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.605717 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.606621 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.606956 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.607259 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.607572 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.607942 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.608195 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.608505 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.608800 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.612666 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.612666 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.612666 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.612666 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.612666 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.612666 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.612666 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.612666 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.613802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.613802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.613802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.613802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.613802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.613802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.613802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.613802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.614856 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.614856 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.614856 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.615241 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.624858 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.624858 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.624858 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.624858 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.624858 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.624858 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.624858 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.624858 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.626923 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.626923 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.626923 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.626923 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.626923 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.626923 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.626923 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.626923 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.628111 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.628111 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.628111 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.628111 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.628111 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.628111 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.628111 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.628111 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.629153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.629153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.629153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.629153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.629153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.629153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.629153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.629153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.630152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.630152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.630152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.630152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.630152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.630152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.630152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.630152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.630985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.630985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.630985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.630985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.630985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.630985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.630985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.630985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.631923 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.631923 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.631923 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.631923 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.631923 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.632610 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.632610 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.632952 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.633153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.633333 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.633638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.633987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.634331 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.634710 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.638684 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO dbcounter [None req-af2cee61-1dbe-4421-abd4-97c69ec5e187 None None] Registered counter for database nova_cell0 Jun 16 14:56:22.638863 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.638863 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.638863 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.638863 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.638863 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.638863 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.638863 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.638863 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.639688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.639688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.639688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.639688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.639688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.639688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.639688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.639688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.640331 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.640331 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.640608 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.640934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.641248 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.641798 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.642032 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.642422 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.642587 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.642943 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.643215 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.643560 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.643771 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.644083 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.644339 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_db.sqlalchemy.engines [None req-af2cee61-1dbe-4421-abd4-97c69ec5e187 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:56:22.644447 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.644705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.645040 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.645391 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.645648 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.646004 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.646552 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.646671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.647008 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.647519 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.647689 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.647976 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.648287 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.648509 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.648812 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.649154 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.649465 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.649780 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.650093 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.650271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writer thread running {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:56:22.650424 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.650997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.651268 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.651583 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.651897 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.653024 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.653332 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.653645 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.653955 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.654268 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.654584 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.654886 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.655198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.655589 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.655817 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.656126 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.656538 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.656777 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.657153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.657549 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.657814 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.658129 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.658444 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.658876 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.659118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.659458 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.659740 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.660223 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.660786 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.661318 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.661823 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.662361 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.662897 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.663634 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.664237 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.665001 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.665537 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.666332 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.666944 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.667583 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.668238 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.669337 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.669679 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.670017 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.670602 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.670933 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.671283 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.671627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.672094 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.672612 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.672978 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.673321 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.673638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.674003 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.674273 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.674591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.674903 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.675240 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.675560 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.675907 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.676268 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.676587 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.677183 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.677546 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.677867 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.678199 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.678540 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.678851 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.679162 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.679491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.679803 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.680172 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.680433 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.680747 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.681080 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.681387 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.681701 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.682009 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.682316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.682628 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.682984 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.683261 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.683686 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.683906 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.684451 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.684596 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.685010 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.685190 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.685501 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.685816 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.686132 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.686422 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.686737 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.687096 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.687352 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.687658 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.688039 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.688317 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.688649 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.689053 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.690559 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.690559 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.690559 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.690559 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.691055 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.691055 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.691280 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.691740 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.692207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.692546 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.692892 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.693296 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.693640 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.693995 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.694308 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.694617 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.694946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.695267 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.695581 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.695897 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.696211 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.696526 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.696851 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.697264 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.697483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.697784 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.698094 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.698404 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.698713 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.699023 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.702043 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.702043 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.702043 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.702043 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.702043 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.702043 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.702043 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.702043 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.702715 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.702715 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.702715 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.702715 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.703049 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.703339 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.703765 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.704081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.704398 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.704720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.705063 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.705390 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.705718 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.706031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.706353 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.706664 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.706995 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.707347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.707677 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.708004 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.708313 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.708617 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.708944 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.709264 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.709588 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.709901 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.710198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.710501 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.710809 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.711112 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.711420 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.711728 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.712039 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.712346 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.712676 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.713004 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.713308 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.713693 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.713935 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.714239 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.714666 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.715680 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.716001 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.716312 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.716623 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.716954 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.717303 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.717643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.717961 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.718288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.718603 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.718930 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.719284 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.719607 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.719939 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.720258 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.720570 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.720939 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.721254 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.721564 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.721875 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.722244 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.722492 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.722802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.723144 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.723474 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.723783 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.724106 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.724423 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.724747 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.725098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.725407 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.725746 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.726088 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.726369 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.726688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.727000 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.727311 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.727626 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.728285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.728285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.728577 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.728921 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.729253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.729582 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.729942 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.730256 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.730692 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.731493 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.731812 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.732124 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.732748 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 14:56:22.732748 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 14:56:22.798051 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO dbcounter [None req-52c0f69d-a095-4a22-8770-d776b9871af7 None None] Registered counter for database nova_api Jun 16 14:56:22.819642 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_db.sqlalchemy.engines [None req-52c0f69d-a095-4a22-8770-d776b9871af7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:56:22.831728 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writer thread running {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:56:22.941145 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.context [None req-52c0f69d-a095-4a22-8770-d776b9871af7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5bf84c3a-2cb0-4224-8719-767e2c0696c7(cell1) {{(pid=124589) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 14:56:22.948888 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52c0f69d-a095-4a22-8770-d776b9871af7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:22.952490 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52c0f69d-a095-4a22-8770-d776b9871af7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:22.954311 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52c0f69d-a095-4a22-8770-d776b9871af7 None None] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:56:22.957873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52c0f69d-a095-4a22-8770-d776b9871af7 None None] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:56:22.961420 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO dbcounter [None req-52c0f69d-a095-4a22-8770-d776b9871af7 None None] Registered counter for database nova_cell0 Jun 16 14:56:22.969037 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO dbcounter [None req-52c0f69d-a095-4a22-8770-d776b9871af7 None None] Registered counter for database nova_cell1 Jun 16 14:56:22.979997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_db.sqlalchemy.engines [None req-52c0f69d-a095-4a22-8770-d776b9871af7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:56:22.986827 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writer thread running {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:56:22.988675 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_db.sqlalchemy.engines [None req-52c0f69d-a095-4a22-8770-d776b9871af7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:56:23.082464 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: WARNING keystonemiddleware.auth_token [None req-af2cee61-1dbe-4421-abd4-97c69ec5e187 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:56:23.090099 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: WARNING keystonemiddleware.auth_token [None req-af2cee61-1dbe-4421-abd4-97c69ec5e187 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:56:23.140519 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writer thread running {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:56:23.152100 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO dbcounter [None req-52c0f69d-a095-4a22-8770-d776b9871af7 None None] Registered counter for database nova_cell0 Jun 16 14:56:23.162488 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_db.sqlalchemy.engines [None req-52c0f69d-a095-4a22-8770-d776b9871af7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 14:56:23.169312 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writer thread running {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 14:56:23.441865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: WARNING keystonemiddleware.auth_token [None req-af2cee61-1dbe-4421-abd4-97c69ec5e187 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:56:23.448165 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: WARNING keystonemiddleware.auth_token [None req-af2cee61-1dbe-4421-abd4-97c69ec5e187 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:56:23.453600 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5603d27959c0 pid: 124590 (default app) Jun 16 14:56:23.504547 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: WARNING keystonemiddleware.auth_token [None req-52c0f69d-a095-4a22-8770-d776b9871af7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:56:23.512013 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: WARNING keystonemiddleware.auth_token [None req-52c0f69d-a095-4a22-8770-d776b9871af7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:56:23.858531 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: WARNING keystonemiddleware.auth_token [None req-52c0f69d-a095-4a22-8770-d776b9871af7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 14:56:23.864667 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: WARNING keystonemiddleware.auth_token [None req-52c0f69d-a095-4a22-8770-d776b9871af7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 14:56:23.870096 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5603d27959c0 pid: 124589 (default app) Jun 16 14:57:04.898956 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=3 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:04.903110 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=3 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:04.908195 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=3 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:04.909337 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=3 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:05.697624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:05.699146 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:05.700146 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:05.702019 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:06.737884 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c7a26c2e-93e6-4173-b343-b3b8c41f4cbc tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] Action: 'create', calling method: .version_select at 0x7faab82ba790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-116064877", "metadata": {"Type": "work"}}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c7a26c2e-93e6-4173-b343-b3b8c41f4cbc tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] Request method failure captured: Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 121 Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TA3Ws6iDRGY00oyn74ospIo-cMD4EnqPhXpmv0dAxNkuphkBMw1q2eB705h21AeKXZYY_-C5QpwS0P_nFzjw83bTPsHj3FljircKdO9xm60XRE0yM0OgUK9GdICn6A7EMXjSEQtRb--6nM1lwQzRLsAb305G8DwCXZdDNLkNtrK1I Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 420ebcc3dace46768bf717e019a47c2f Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-VolumesNegativeTest-253495381 Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 14:57:06.779041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 14:57:06.780770 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_420ebcc3dace46768bf717e019a47c2f", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/420ebcc3dace46768bf717e019a47c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/420ebcc3dace46768bf717e019a47c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/420ebcc3dace46768bf717e019a47c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:57:06.780770 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-VolumesNegativeTest-253495381 Jun 16 14:57:06.780770 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 420ebcc3dace46768bf717e019a47c2f Jun 16 14:57:06.780770 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-VolumesNegativeTest-253495381 Jun 16 14:57:06.780770 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-VolumesNegativeTest-253495381-project Jun 16 14:57:06.780770 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 14:57:06.780770 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 14:57:06.780770 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 9fda7395f88846e4a3d8b270fb1ee564 Jun 16 14:57:06.780770 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-VolumesNegativeTest-253495381-project Jun 16 14:57:06.780770 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Jun 16 14:57:06.780770 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-116064877", "metadata": {"Type": "work"}}} Jun 16 14:57:06.780770 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: Jun 16 14:57:06.780770 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-116064877', 'metadata': {'Type': 'work'}}}} Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:57:06.781810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:57:06.783528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:57:06.783528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:57:06.783528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:57:06.783528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:57:06.783528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:57:06.783528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:57:06.783528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:57:06.783528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:57:06.783528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:57:06.783528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:57:06.783528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 14:57:06.783528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.783528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:06.783528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.783528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:06.783528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:06.783528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:06.783528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:57:06.783528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:57:06.784950 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 14:57:06.784950 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.784950 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c7a26c2e-93e6-4173-b343-b3b8c41f4cbc tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:57:06.784950 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c7a26c2e-93e6-4173-b343-b3b8c41f4cbc tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.912658 Jun 16 14:57:06.784950 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 1/1] 10.222.0.72 () {60 vars in 1155 bytes} [Thu Jun 16 14:57:04 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1918 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:57:06.799914 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4a588e34-b11a-423a-a564-b7d006a314ca tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] Action: 'create', calling method: .version_select at 0x7faab8285a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1292383457", "metadata": {"Type": "work"}}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4a588e34-b11a-423a-a564-b7d006a314ca tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] Request method failure captured: Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 120 Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TA3Ws6iDRGY00oyn74ospIo-cMD4EnqPhXpmv0dAxNkuphkBMw1q2eB705h21AeKXZYY_-C5QpwS0P_nFzjw83bTPsHj3FljircKdO9xm60XRE0yM0OgUK9GdICn6A7EMXjSEQtRb--6nM1lwQzRLsAb305G8DwCXZdDNLkNtrK1I Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 420ebcc3dace46768bf717e019a47c2f Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-VolumesNegativeTest-253495381 Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 14:57:06.808985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 14:57:06.810639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_420ebcc3dace46768bf717e019a47c2f", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/420ebcc3dace46768bf717e019a47c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/420ebcc3dace46768bf717e019a47c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/420ebcc3dace46768bf717e019a47c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:57:06.810639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-VolumesNegativeTest-253495381 Jun 16 14:57:06.810639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 420ebcc3dace46768bf717e019a47c2f Jun 16 14:57:06.810639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-VolumesNegativeTest-253495381 Jun 16 14:57:06.810639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-VolumesNegativeTest-253495381-project Jun 16 14:57:06.810639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 14:57:06.810639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 14:57:06.810639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 9fda7395f88846e4a3d8b270fb1ee564 Jun 16 14:57:06.810639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-VolumesNegativeTest-253495381-project Jun 16 14:57:06.810639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Jun 16 14:57:06.810639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1292383457", "metadata": {"Type": "work"}}} Jun 16 14:57:06.810639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: Jun 16 14:57:06.810639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1292383457', 'metadata': {'Type': 'work'}}}} Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi '0' Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:57:06.811699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:57:06.814708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:57:06.814708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:57:06.814708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:57:06.814708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:57:06.814708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:57:06.814708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:57:06.814708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:57:06.814708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:57:06.814708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:57:06.814708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:57:06.814708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 14:57:06.814708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.814708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:06.814708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.814708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:06.814708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:06.814708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:06.814708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:57:06.814708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:57:06.817390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 14:57:06.817390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.817390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4a588e34-b11a-423a-a564-b7d006a314ca tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:57:06.817390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4a588e34-b11a-423a-a564-b7d006a314ca tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023772 Jun 16 14:57:06.824786 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 2/2] 10.222.0.72 () {60 vars in 1155 bytes} [Thu Jun 16 14:57:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:57:06.853242 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e903d955-b5bd-4e9c-9823-5ba27da1d02b tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] Action: 'create', calling method: .version_select at 0x7faab82ba9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1067658234", "metadata": {"Type": "work"}}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e903d955-b5bd-4e9c-9823-5ba27da1d02b tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] Request method failure captured: Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 119 Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TA3Ws6iDRGY00oyn74ospIo-cMD4EnqPhXpmv0dAxNkuphkBMw1q2eB705h21AeKXZYY_-C5QpwS0P_nFzjw83bTPsHj3FljircKdO9xm60XRE0yM0OgUK9GdICn6A7EMXjSEQtRb--6nM1lwQzRLsAb305G8DwCXZdDNLkNtrK1I Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 420ebcc3dace46768bf717e019a47c2f Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-VolumesNegativeTest-253495381 Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 14:57:06.864429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 14:57:06.866078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_420ebcc3dace46768bf717e019a47c2f", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/420ebcc3dace46768bf717e019a47c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/420ebcc3dace46768bf717e019a47c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/420ebcc3dace46768bf717e019a47c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:57:06.866078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-VolumesNegativeTest-253495381 Jun 16 14:57:06.866078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 420ebcc3dace46768bf717e019a47c2f Jun 16 14:57:06.866078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-VolumesNegativeTest-253495381 Jun 16 14:57:06.866078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-VolumesNegativeTest-253495381-project Jun 16 14:57:06.866078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 14:57:06.866078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 14:57:06.866078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 9fda7395f88846e4a3d8b270fb1ee564 Jun 16 14:57:06.866078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-VolumesNegativeTest-253495381-project Jun 16 14:57:06.866078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Jun 16 14:57:06.866078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1067658234", "metadata": {"Type": "work"}}} Jun 16 14:57:06.866078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: Jun 16 14:57:06.866078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1067658234', 'metadata': {'Type': 'work'}}}} Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise error Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi '' Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:57:06.867015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:57:06.868533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:57:06.868533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:57:06.868533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:57:06.868533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:57:06.868533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 14:57:06.868533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 14:57:06.868533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 14:57:06.868533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 14:57:06.868533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 14:57:06.868533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 14:57:06.868533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 14:57:06.868533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.868533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:06.868533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.868533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:06.868533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:06.868533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:06.868533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 14:57:06.868533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 14:57:06.869869 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 14:57:06.869869 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:06.869869 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e903d955-b5bd-4e9c-9823-5ba27da1d02b tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:57:06.869869 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e903d955-b5bd-4e9c-9823-5ba27da1d02b tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.042586 Jun 16 14:57:06.872177 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 3/3] 10.222.0.72 () {60 vars in 1155 bytes} [Thu Jun 16 14:57:06 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 14:57:06.895362 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8f93a61e-8911-4708-ac26-bd8e8c2ff766 tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] Calling method '.version_select at 0x7faab81e3790>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:07.091065 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-84f8983f-6e3b-409d-b490-669818f4ff03 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Action: 'create', calling method: .version_select at 0x7faab82725e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-561086689"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:07.942366 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-8f93a61e-8911-4708-ac26-bd8e8c2ff766 tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] HTTP exception thrown: Volume tempest-invalid-360417298 could not be found. Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8f93a61e-8911-4708-ac26-bd8e8c2ff766 tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] Request method failure captured: Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-360417298 HTTP/1.1 Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TA3Ws6iDRGY00oyn74ospIo-cMD4EnqPhXpmv0dAxNkuphkBMw1q2eB705h21AeKXZYY_-C5QpwS0P_nFzjw83bTPsHj3FljircKdO9xm60XRE0yM0OgUK9GdICn6A7EMXjSEQtRb--6nM1lwQzRLsAb305G8DwCXZdDNLkNtrK1I Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 420ebcc3dace46768bf717e019a47c2f Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-VolumesNegativeTest-253495381 Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 14:57:07.948072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 14:57:07.951332 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_420ebcc3dace46768bf717e019a47c2f", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/420ebcc3dace46768bf717e019a47c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/420ebcc3dace46768bf717e019a47c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/420ebcc3dace46768bf717e019a47c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:57:07.951332 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-VolumesNegativeTest-253495381 Jun 16 14:57:07.951332 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 420ebcc3dace46768bf717e019a47c2f Jun 16 14:57:07.951332 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-VolumesNegativeTest-253495381 Jun 16 14:57:07.951332 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-VolumesNegativeTest-253495381-project Jun 16 14:57:07.951332 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 14:57:07.951332 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 14:57:07.951332 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 9fda7395f88846e4a3d8b270fb1ee564 Jun 16 14:57:07.951332 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-VolumesNegativeTest-253495381-project Jun 16 14:57:07.951332 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: Jun 16 14:57:07.951332 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Volume tempest-invalid-360417298 could not be found. Jun 16 14:57:07.951332 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': 'tempest-invalid-360417298'} Jun 16 14:57:07.951332 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:57:07.952937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:07.952937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:57:07.952937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:57:07.952937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 14:57:07.952937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 14:57:07.952937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 14:57:07.952937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 14:57:07.952937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 14:57:07.952937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 14:57:07.952937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 14:57:07.952937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 14:57:07.952937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:57:07.952937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:57:07.952937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:57:07.952937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:57:07.952937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-360417298 could not be found. (HTTP 404) (Request-ID: req-9a0a693f-aa7f-4a9c-bca6-84b8e51206af) Jun 16 14:57:07.952937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:07.952937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:07.952937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:07.955480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:07.955480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 14:57:07.955480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 14:57:07.955480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 14:57:07.955480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 14:57:07.955480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 14:57:07.955480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 14:57:07.955480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 14:57:07.955480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 14:57:07.955480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:57:07.955480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:57:07.955480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 14:57:07.955480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 14:57:07.955480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 14:57:07.955480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 14:57:07.955480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 14:57:07.955480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 14:57:07.955480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 14:57:07.955480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-360417298 could not be found. Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:57:07.960606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-360417298 could not be found. Jun 16 14:57:07.963640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:07.963640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:07.963640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:07.963640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:07.963640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:07.963640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:07.963640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:57:07.963640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:57:07.963640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-360417298 could not be found. Jun 16 14:57:07.963640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:07.967206 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8f93a61e-8911-4708-ac26-bd8e8c2ff766 tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] Returning 404 to user: Volume tempest-invalid-360417298 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:57:07.967206 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8f93a61e-8911-4708-ac26-bd8e8c2ff766 tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/tempest-invalid-360417298" status: 404 len: 98 microversion: 2.1 time: 1.083832 Jun 16 14:57:07.971688 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 4/4] 10.222.0.72 () {58 vars in 1214 bytes} [Thu Jun 16 14:57:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-360417298 => generated 98 bytes in 1090 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 16 14:57:08.001457 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-47291237-936d-4d4d-ace0-6a9c5a3fadd0 tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.020627 Jun 16 14:57:08.004478 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 5/5] 10.222.0.72 () {58 vars in 1139 bytes} [Thu Jun 16 14:57:07 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 14:57:08.021436 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7150fc71-2911-48e4-844e-f207782d5792 tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009302 Jun 16 14:57:08.022387 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 6/6] 10.222.0.72 () {58 vars in 1136 bytes} [Thu Jun 16 14:57:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 16 14:57:08.037451 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-89f9dfc1-8ce2-44db-9da5-1be578796329 tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] Calling method '.version_select at 0x7faab8113b80>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:08.225954 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-89f9dfc1-8ce2-44db-9da5-1be578796329 tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] HTTP exception thrown: Volume e8ef7285-19e0-410c-b6fc-391113143d56 could not be found. Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-89f9dfc1-8ce2-44db-9da5-1be578796329 tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] Request method failure captured: Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: DELETE /compute/v2.1/os-volumes/e8ef7285-19e0-410c-b6fc-391113143d56 HTTP/1.1 Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TA3Ws6iDRGY00oyn74ospIo-cMD4EnqPhXpmv0dAxNkuphkBMw1q2eB705h21AeKXZYY_-C5QpwS0P_nFzjw83bTPsHj3FljircKdO9xm60XRE0yM0OgUK9GdICn6A7EMXjSEQtRb--6nM1lwQzRLsAb305G8DwCXZdDNLkNtrK1I Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 420ebcc3dace46768bf717e019a47c2f Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-VolumesNegativeTest-253495381 Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 14:57:08.228865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 14:57:08.231022 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_420ebcc3dace46768bf717e019a47c2f", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/420ebcc3dace46768bf717e019a47c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/420ebcc3dace46768bf717e019a47c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/420ebcc3dace46768bf717e019a47c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:57:08.231022 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-VolumesNegativeTest-253495381 Jun 16 14:57:08.231022 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 420ebcc3dace46768bf717e019a47c2f Jun 16 14:57:08.231022 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-VolumesNegativeTest-253495381 Jun 16 14:57:08.231022 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-VolumesNegativeTest-253495381-project Jun 16 14:57:08.231022 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 14:57:08.231022 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 14:57:08.231022 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 9fda7395f88846e4a3d8b270fb1ee564 Jun 16 14:57:08.231022 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-VolumesNegativeTest-253495381-project Jun 16 14:57:08.231022 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: Jun 16 14:57:08.231022 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Volume e8ef7285-19e0-410c-b6fc-391113143d56 could not be found. Jun 16 14:57:08.231022 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': 'e8ef7285-19e0-410c-b6fc-391113143d56'} Jun 16 14:57:08.231022 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:57:08.231802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:08.231802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:57:08.231802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:57:08.231802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 14:57:08.231802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 14:57:08.231802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 14:57:08.231802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 14:57:08.231802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 14:57:08.231802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 14:57:08.231802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 14:57:08.231802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 14:57:08.231802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:57:08.231802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:57:08.231802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:57:08.231802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:57:08.231802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8ef7285-19e0-410c-b6fc-391113143d56 could not be found. (HTTP 404) (Request-ID: req-e5fa7e86-8638-4de4-b58d-356aaa2f0189) Jun 16 14:57:08.231802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.231802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:08.231802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.232936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:08.232936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 14:57:08.232936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 14:57:08.232936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 14:57:08.232936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 14:57:08.232936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 14:57:08.232936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 14:57:08.232936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 14:57:08.232936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 14:57:08.232936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:57:08.232936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:57:08.232936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 14:57:08.232936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 14:57:08.232936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 14:57:08.232936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 14:57:08.232936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 14:57:08.232936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 14:57:08.232936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 14:57:08.232936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 14:57:08.234061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:57:08.234061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:57:08.234061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:57:08.234061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:57:08.234061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8ef7285-19e0-410c-b6fc-391113143d56 could not be found. Jun 16 14:57:08.234061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.234061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:08.234061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.234061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:08.234061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:08.234061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:08.234061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:57:08.234061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:57:08.234061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:57:08.234061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:57:08.234061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:57:08.234061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:57:08.234061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 14:57:08.234061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:57:08.235173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e8ef7285-19e0-410c-b6fc-391113143d56 could not be found. Jun 16 14:57:08.235173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.235173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:08.235173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.235173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:08.235173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:08.235173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:08.235173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:57:08.235173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:57:08.235173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8ef7285-19e0-410c-b6fc-391113143d56 could not be found. Jun 16 14:57:08.235173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.235173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-89f9dfc1-8ce2-44db-9da5-1be578796329 tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] Returning 404 to user: Volume e8ef7285-19e0-410c-b6fc-391113143d56 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:57:08.235173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-89f9dfc1-8ce2-44db-9da5-1be578796329 tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/e8ef7285-19e0-410c-b6fc-391113143d56" status: 404 len: 109 microversion: 2.1 time: 0.203240 Jun 16 14:57:08.235173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 7/7] 10.222.0.72 () {58 vars in 1247 bytes} [Thu Jun 16 14:57:08 2022] DELETE /compute/v2.1/os-volumes/e8ef7285-19e0-410c-b6fc-391113143d56 => generated 109 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 14:57:08.255884 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2346c272-27c7-4d9d-9ad7-ac79c78f82ca tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] Calling method '.version_select at 0x7faab8113b80>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:08.391912 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-2346c272-27c7-4d9d-9ad7-ac79c78f82ca tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] HTTP exception thrown: Volume 5eb1d249-2365-4ed6-849e-6fcebc4fe395 could not be found. Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2346c272-27c7-4d9d-9ad7-ac79c78f82ca tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] Request method failure captured: Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/os-volumes/5eb1d249-2365-4ed6-849e-6fcebc4fe395 HTTP/1.1 Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TA3Ws6iDRGY00oyn74ospIo-cMD4EnqPhXpmv0dAxNkuphkBMw1q2eB705h21AeKXZYY_-C5QpwS0P_nFzjw83bTPsHj3FljircKdO9xm60XRE0yM0OgUK9GdICn6A7EMXjSEQtRb--6nM1lwQzRLsAb305G8DwCXZdDNLkNtrK1I Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 420ebcc3dace46768bf717e019a47c2f Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-VolumesNegativeTest-253495381 Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 14:57:08.395390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 14:57:08.396749 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_420ebcc3dace46768bf717e019a47c2f", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/420ebcc3dace46768bf717e019a47c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/420ebcc3dace46768bf717e019a47c2f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/420ebcc3dace46768bf717e019a47c2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:57:08.396749 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-VolumesNegativeTest-253495381 Jun 16 14:57:08.396749 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 420ebcc3dace46768bf717e019a47c2f Jun 16 14:57:08.396749 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-VolumesNegativeTest-253495381 Jun 16 14:57:08.396749 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-VolumesNegativeTest-253495381-project Jun 16 14:57:08.396749 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 14:57:08.396749 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 14:57:08.396749 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 9fda7395f88846e4a3d8b270fb1ee564 Jun 16 14:57:08.396749 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-VolumesNegativeTest-253495381-project Jun 16 14:57:08.396749 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: Jun 16 14:57:08.396749 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Volume 5eb1d249-2365-4ed6-849e-6fcebc4fe395 could not be found. Jun 16 14:57:08.396749 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': '5eb1d249-2365-4ed6-849e-6fcebc4fe395'} Jun 16 14:57:08.396749 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:57:08.397558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:08.397558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:57:08.397558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:57:08.397558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 14:57:08.397558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 14:57:08.397558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 14:57:08.397558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 14:57:08.397558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:57:08.397558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:57:08.397558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:57:08.397558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:57:08.397558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:57:08.397558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:57:08.397558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:57:08.397558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:57:08.397558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5eb1d249-2365-4ed6-849e-6fcebc4fe395 could not be found. (HTTP 404) (Request-ID: req-35928996-7780-47e8-abe2-164a72202849) Jun 16 14:57:08.397558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.397558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:08.397558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.398667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:08.398667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 14:57:08.398667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 14:57:08.398667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 14:57:08.398667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 14:57:08.398667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 14:57:08.398667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 14:57:08.398667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 14:57:08.398667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 14:57:08.398667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:57:08.398667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:57:08.398667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 14:57:08.398667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 14:57:08.398667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 14:57:08.398667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 14:57:08.398667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:57:08.398667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:57:08.398667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:57:08.398667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:57:08.399838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:57:08.399838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:57:08.399838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:57:08.399838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:57:08.399838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5eb1d249-2365-4ed6-849e-6fcebc4fe395 could not be found. Jun 16 14:57:08.399838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.399838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:08.399838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.399838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:08.399838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:08.399838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:08.399838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:57:08.399838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:57:08.399838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:57:08.399838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:57:08.399838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:57:08.399838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:57:08.399838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 14:57:08.399838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:57:08.400997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5eb1d249-2365-4ed6-849e-6fcebc4fe395 could not be found. Jun 16 14:57:08.400997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.400997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:08.400997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.400997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:08.400997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:08.400997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:08.400997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:57:08.400997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:57:08.400997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5eb1d249-2365-4ed6-849e-6fcebc4fe395 could not be found. Jun 16 14:57:08.400997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:57:08.400997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2346c272-27c7-4d9d-9ad7-ac79c78f82ca tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] Returning 404 to user: Volume 5eb1d249-2365-4ed6-849e-6fcebc4fe395 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:57:08.400997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2346c272-27c7-4d9d-9ad7-ac79c78f82ca tempest-VolumesNegativeTest-253495381 tempest-VolumesNegativeTest-253495381-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/5eb1d249-2365-4ed6-849e-6fcebc4fe395" status: 404 len: 109 microversion: 2.1 time: 0.155489 Jun 16 14:57:08.400997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 8/8] 10.222.0.72 () {58 vars in 1244 bytes} [Thu Jun 16 14:57:08 2022] GET /compute/v2.1/os-volumes/5eb1d249-2365-4ed6-849e-6fcebc4fe395 => generated 109 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:57:08.614294 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-544b7701-0659-40f0-bfe4-37609a37e3d4 tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] Calling method '.version_select at 0x7faab811e550>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:08.824270 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-544b7701-0659-40f0-bfe4-37609a37e3d4 tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/83d971c2-b3fd-4145-9c48-e68fda3776f7" status: 200 len: 350 microversion: 2.1 time: 0.217945 Jun 16 14:57:08.825309 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 9/9] 10.222.0.72 () {58 vars in 1244 bytes} [Thu Jun 16 14:57:08 2022] GET /compute/v2.1/os-volumes/83d971c2-b3fd-4145-9c48-e68fda3776f7 => generated 350 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:57:08.906558 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-84f8983f-6e3b-409d-b490-669818f4ff03 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.214619 Jun 16 14:57:08.908365 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 1/10] 10.222.0.72 () {60 vars in 1154 bytes} [Thu Jun 16 14:57:05 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3218 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 16 14:57:08.928489 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-59225514-3e1f-4547-bb0f-cb792f6dc394 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Calling method '.version_select at 0x7faab81130d0>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:09.051737 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-59225514-3e1f-4547-bb0f-cb792f6dc394 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/1e5e3bac-58ef-4420-9e8d-edf783897a5a" status: 200 len: 344 microversion: 2.1 time: 0.127540 Jun 16 14:57:09.052337 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 10/11] 10.222.0.72 () {58 vars in 1244 bytes} [Thu Jun 16 14:57:08 2022] GET /compute/v2.1/os-volumes/1e5e3bac-58ef-4420-9e8d-edf783897a5a => generated 344 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:10.066039 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-22cd6a9c-33a3-43da-9090-9c0b5a1b8142 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Calling method '.version_select at 0x7faab81384c0>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:10.174924 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-22cd6a9c-33a3-43da-9090-9c0b5a1b8142 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/1e5e3bac-58ef-4420-9e8d-edf783897a5a" status: 200 len: 345 microversion: 2.1 time: 0.112280 Jun 16 14:57:10.175816 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 2/12] 10.222.0.72 () {58 vars in 1244 bytes} [Thu Jun 16 14:57:10 2022] GET /compute/v2.1/os-volumes/1e5e3bac-58ef-4420-9e8d-edf783897a5a => generated 345 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:10.205518 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d55e1b3a-2df3-4629-b775-1e2599760556 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Action: 'create', calling method: .version_select at 0x7faab8113160>, body: {"snapshot": {"volume_id": "1e5e3bac-58ef-4420-9e8d-edf783897a5a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1031511390"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:10.650839 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f40cfd96-c0c0-4a81-9d92-00cd1573a2f4 tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] Calling method '.version_select at 0x7faab8138820>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:10.760497 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f40cfd96-c0c0-4a81-9d92-00cd1573a2f4 tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/5fd822e7-4827-4b6e-9ae6-fc1b39404d52" status: 200 len: 350 microversion: 2.1 time: 0.113556 Jun 16 14:57:10.767468 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 3/13] 10.222.0.72 () {58 vars in 1244 bytes} [Thu Jun 16 14:57:10 2022] GET /compute/v2.1/os-volumes/5fd822e7-4827-4b6e-9ae6-fc1b39404d52 => generated 350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:57:11.154885 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d55e1b3a-2df3-4629-b775-1e2599760556 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.966949 Jun 16 14:57:11.156637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 11/14] 10.222.0.72 () {60 vars in 1161 bytes} [Thu Jun 16 14:57:10 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:11.174841 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4bd2fe8e-dbdb-49ca-b36e-7329974d5bbb tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Calling method '.version_select at 0x7faab8138ca0>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:11.326408 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4bd2fe8e-dbdb-49ca-b36e-7329974d5bbb tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29" status: 200 len: 287 microversion: 2.1 time: 0.160918 Jun 16 14:57:11.327467 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 4/15] 10.222.0.72 () {58 vars in 1250 bytes} [Thu Jun 16 14:57:11 2022] GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29 => generated 287 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:57:11.346610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3a37ab30-0f4b-49e0-ba18-7d524d369205 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Calling method '.version_select at 0x7faab811ec10>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:11.495171 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3a37ab30-0f4b-49e0-ba18-7d524d369205 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.155894 Jun 16 14:57:11.496239 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 12/16] 10.222.0.72 () {58 vars in 1139 bytes} [Thu Jun 16 14:57:11 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:11.507393 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5498f3bb-1640-4071-836b-8b290f345aa4 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Calling method '.version_select at 0x7faab814e430>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:11.558132 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5498f3bb-1640-4071-836b-8b290f345aa4 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29" status: 200 len: 287 microversion: 2.1 time: 0.055430 Jun 16 14:57:11.559300 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 5/17] 10.222.0.72 () {58 vars in 1250 bytes} [Thu Jun 16 14:57:11 2022] GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29 => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:57:12.571240 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c9fb8661-69a8-43fc-b811-aebf40513286 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Calling method '.version_select at 0x7faab811e040>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:12.626472 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c9fb8661-69a8-43fc-b811-aebf40513286 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29" status: 200 len: 287 microversion: 2.1 time: 0.059640 Jun 16 14:57:12.627779 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 13/18] 10.222.0.72 () {58 vars in 1250 bytes} [Thu Jun 16 14:57:12 2022] GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:13.649539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d4ac0e59-6eb7-41f4-97ed-1a3e5e977441 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Calling method '.version_select at 0x7faab8138d30>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:13.823885 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d4ac0e59-6eb7-41f4-97ed-1a3e5e977441 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29" status: 200 len: 287 microversion: 2.1 time: 0.185264 Jun 16 14:57:13.824774 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 6/19] 10.222.0.72 () {58 vars in 1250 bytes} [Thu Jun 16 14:57:13 2022] GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29 => generated 287 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:14.836000 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-33d90072-06fc-40e5-8c7d-e299dd579eaa tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Calling method '.version_select at 0x7faab811e820>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:14.947421 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-33d90072-06fc-40e5-8c7d-e299dd579eaa tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29" status: 200 len: 287 microversion: 2.1 time: 0.115819 Jun 16 14:57:14.950096 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 14/20] 10.222.0.72 () {58 vars in 1250 bytes} [Thu Jun 16 14:57:14 2022] GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29 => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:15.965987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3e475ece-5ba9-4d50-94c4-c3a87a9b04e3 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Calling method '.version_select at 0x7faab8138790>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:16.045014 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3e475ece-5ba9-4d50-94c4-c3a87a9b04e3 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29" status: 200 len: 287 microversion: 2.1 time: 0.086040 Jun 16 14:57:16.048791 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 7/21] 10.222.0.72 () {58 vars in 1250 bytes} [Thu Jun 16 14:57:15 2022] GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29 => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:17.058481 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d3410628-df35-4c1d-a655-5e0dd6b0eab6 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Calling method '.version_select at 0x7faab814e550>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:17.118239 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c6ba95a2-f29b-47c0-8faf-c5f390544df1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Action: 'create', calling method: .version_select at 0x7faab8113550>, body: {"keypair": {"name": "tempest-keypair-1006749574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkGGXXoXmJWiv8OK/6lGiDzs5/7zNp0/yoKLayFTadPiObFrYYUzzi4zA3vSq8PJLoaYFFBbaIVjviAaIUHh+/GPlVtvomMLy7YALsrEAqsXzA/pNZ3AdjFwWjwv1tzaw=="}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:17.226874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d3410628-df35-4c1d-a655-5e0dd6b0eab6 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29" status: 200 len: 287 microversion: 2.1 time: 0.173981 Jun 16 14:57:17.227839 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 8/22] 10.222.0.72 () {58 vars in 1250 bytes} [Thu Jun 16 14:57:17 2022] GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29 => generated 287 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:57:17.233616 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-c6ba95a2-f29b-47c0-8faf-c5f390544df1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Getting quotas for project 2a4c67a42f8a405d84d4697a45e962ff. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:57:17.249807 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-c6ba95a2-f29b-47c0-8faf-c5f390544df1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Getting quotas for user ba40bcf173404e6c8b17d311b65bf780 and project 2a4c67a42f8a405d84d4697a45e962ff. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:57:17.386240 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c6ba95a2-f29b-47c0-8faf-c5f390544df1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.570009 Jun 16 14:57:17.386850 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 15/23] 10.222.0.72 () {62 vars in 1199 bytes} [Thu Jun 16 14:57:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 571 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 16 14:57:18.241994 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-90332ef3-20b5-4be7-ac01-e380d7d4cd3f tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Calling method '.version_select at 0x7faab814eb80>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:18.322151 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-90332ef3-20b5-4be7-ac01-e380d7d4cd3f tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29" status: 200 len: 288 microversion: 2.1 time: 0.086469 Jun 16 14:57:18.323150 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 9/24] 10.222.0.72 () {58 vars in 1250 bytes} [Thu Jun 16 14:57:18 2022] GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29 => generated 288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:18.334542 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-aac8798e-a38c-4e89-823a-f7cc284e8fc3 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Calling method '.version_select at 0x7faab806ef70>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:18.592044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-aac8798e-a38c-4e89-823a-f7cc284e8fc3 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "DELETE /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29" status: 202 len: 0 microversion: 2.1 time: 0.262598 Jun 16 14:57:18.592769 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 16/25] 10.222.0.72 () {58 vars in 1253 bytes} [Thu Jun 16 14:57:18 2022] DELETE /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:57:18.601500 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-193c3eaa-efd5-4de1-bd6e-3d5de31bc6c7 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Calling method '.version_select at 0x7faab8138820>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:18.663651 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-193c3eaa-efd5-4de1-bd6e-3d5de31bc6c7 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29" status: 200 len: 287 microversion: 2.1 time: 0.066415 Jun 16 14:57:18.664640 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 10/26] 10.222.0.72 () {58 vars in 1250 bytes} [Thu Jun 16 14:57:18 2022] GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:19.563761 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c551eb5d-9f99-4fa9-9c3d-0cd9c635e3d9 tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] Calling method '.version_select at 0x7faab8128670>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:19.676578 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e9a1853c-8060-40af-97db-a4b42b1fb86d tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Calling method '.version_select at 0x7faab8138ca0>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:19.697450 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c551eb5d-9f99-4fa9-9c3d-0cd9c635e3d9 tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/5e40fc42-62fd-4ed5-a033-05d65b6b9b93" status: 200 len: 351 microversion: 2.1 time: 0.138600 Jun 16 14:57:19.706835 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 17/27] 10.222.0.72 () {58 vars in 1244 bytes} [Thu Jun 16 14:57:19 2022] GET /compute/v2.1/os-volumes/5e40fc42-62fd-4ed5-a033-05d65b6b9b93 => generated 351 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:19.712015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9db89ab0-821d-4309-bdd3-02167575359a tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] Calling method '.version_select at 0x7faab8128d30>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:19.747543 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-e9a1853c-8060-40af-97db-a4b42b1fb86d tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] HTTP exception thrown: Snapshot 0eb9dbb8-214c-497a-844a-752a13cf0d29 could not be found. Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e9a1853c-8060-40af-97db-a4b42b1fb86d tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Request method failure captured: Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29 HTTP/1.1 Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0TB8cQMbdSyuGeYyC1Ol-jRxKg0SwQMxDYm1KcNypP-IZrXyTdAHQCXlQCx__zFIH0XTE8X4fxBF4XZ5hvPeUq04If9pbcqn8aYbvP-BmyH5mcmc8cinGRZclPeR9J7jfAQGbf2lnxuFRLsE7fhZ695WfBItjFmciI_lBPGA-1nPQc Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 1107ea1ea92647f8a961cb49812b53bd Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1409164476 Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 14:57:19.751988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 14:57:19.753627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1107ea1ea92647f8a961cb49812b53bd", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1107ea1ea92647f8a961cb49812b53bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1107ea1ea92647f8a961cb49812b53bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1107ea1ea92647f8a961cb49812b53bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:57:19.753627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1409164476 Jun 16 14:57:19.753627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 1107ea1ea92647f8a961cb49812b53bd Jun 16 14:57:19.753627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1409164476 Jun 16 14:57:19.753627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-VolumesSnapshotsTestJSON-1409164476-project Jun 16 14:57:19.753627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 14:57:19.753627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 14:57:19.753627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: 9ce13f0b56d84e88a611733039534715 Jun 16 14:57:19.753627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1409164476-project Jun 16 14:57:19.753627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: Jun 16 14:57:19.753627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Snapshot 0eb9dbb8-214c-497a-844a-752a13cf0d29 could not be found. Jun 16 14:57:19.753627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': '0eb9dbb8-214c-497a-844a-752a13cf0d29'} Jun 16 14:57:19.753627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:57:19.754347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:19.754347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 14:57:19.754347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 14:57:19.754347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 14:57:19.754347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 14:57:19.754347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 14:57:19.754347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 14:57:19.754347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:57:19.754347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:57:19.754347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:57:19.754347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:57:19.754347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:57:19.754347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:57:19.754347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:57:19.754347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:57:19.754347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0eb9dbb8-214c-497a-844a-752a13cf0d29 could not be found. (HTTP 404) (Request-ID: req-9f767dc3-181d-4b32-ad81-4a09496dab07) Jun 16 14:57:19.754347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:19.754347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:19.755319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:19.755319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:19.755319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 14:57:19.755319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 14:57:19.755319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 14:57:19.755319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 14:57:19.755319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 14:57:19.755319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 14:57:19.755319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 14:57:19.755319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 14:57:19.755319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 14:57:19.755319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 14:57:19.755319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 14:57:19.755319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 14:57:19.755319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 14:57:19.755319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 14:57:19.755319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:57:19.755319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:57:19.755319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0eb9dbb8-214c-497a-844a-752a13cf0d29 could not be found. Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 14:57:19.757934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:57:19.761073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0eb9dbb8-214c-497a-844a-752a13cf0d29 could not be found. Jun 16 14:57:19.761073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:19.761073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:19.761073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:19.761073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:19.761073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:19.761073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:19.761073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:57:19.761073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:57:19.761073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0eb9dbb8-214c-497a-844a-752a13cf0d29 could not be found. Jun 16 14:57:19.761073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:19.761073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e9a1853c-8060-40af-97db-a4b42b1fb86d tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Returning 404 to user: Snapshot 0eb9dbb8-214c-497a-844a-752a13cf0d29 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:57:19.761073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e9a1853c-8060-40af-97db-a4b42b1fb86d tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29" status: 404 len: 111 microversion: 2.1 time: 0.084109 Jun 16 14:57:19.763108 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 11/28] 10.222.0.72 () {58 vars in 1250 bytes} [Thu Jun 16 14:57:19 2022] GET /compute/v2.1/os-snapshots/0eb9dbb8-214c-497a-844a-752a13cf0d29 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 14:57:19.784506 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d6974df7-d286-48ce-9b2a-b7906be7ce00 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Calling method '.version_select at 0x7faab814ef70>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:19.976641 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9db89ab0-821d-4309-bdd3-02167575359a tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.268343 Jun 16 14:57:19.986429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 18/29] 10.222.0.72 () {58 vars in 1133 bytes} [Thu Jun 16 14:57:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:19.992227 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-76925b41-2e16-4ab0-9032-a0c3d6fbded7 tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] Calling method '.version_select at 0x7faab8128dc0>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:19.992887 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d6974df7-d286-48ce-9b2a-b7906be7ce00 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/1e5e3bac-58ef-4420-9e8d-edf783897a5a" status: 202 len: 0 microversion: 2.1 time: 0.223553 Jun 16 14:57:19.994049 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 12/30] 10.222.0.72 () {58 vars in 1247 bytes} [Thu Jun 16 14:57:19 2022] DELETE /compute/v2.1/os-volumes/1e5e3bac-58ef-4420-9e8d-edf783897a5a => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 14:57:20.003460 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fe9b1fc9-b7fb-499a-a576-29991b6bb1b2 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Calling method '.version_select at 0x7faab80b8700>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:20.147523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fe9b1fc9-b7fb-499a-a576-29991b6bb1b2 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/1e5e3bac-58ef-4420-9e8d-edf783897a5a" status: 200 len: 344 microversion: 2.1 time: 0.148476 Jun 16 14:57:20.148084 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 13/31] 10.222.0.72 () {58 vars in 1244 bytes} [Thu Jun 16 14:57:19 2022] GET /compute/v2.1/os-volumes/1e5e3bac-58ef-4420-9e8d-edf783897a5a => generated 344 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:57:20.337867 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-76925b41-2e16-4ab0-9032-a0c3d6fbded7 tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.350163 Jun 16 14:57:20.339030 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 19/32] 10.222.0.72 () {58 vars in 1148 bytes} [Thu Jun 16 14:57:19 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:20.353085 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f5e91cd5-73ca-4e6c-b824-07561bde4d46 tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] Calling method '.version_select at 0x7faab80b8d30>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:20.580204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f5e91cd5-73ca-4e6c-b824-07561bde4d46 tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] 10.222.0.72 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.231164 Jun 16 14:57:20.581117 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 14/33] 10.222.0.72 () {58 vars in 1133 bytes} [Thu Jun 16 14:57:20 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:20.592216 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d242525f-a3ce-460b-aab2-c89075abf10b tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] Calling method '.version_select at 0x7faab8128040>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:20.865787 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d242525f-a3ce-460b-aab2-c89075abf10b tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] 10.222.0.72 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.277038 Jun 16 14:57:20.874233 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 20/34] 10.222.0.72 () {58 vars in 1166 bytes} [Thu Jun 16 14:57:20 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:20.878856 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b3a0eeaf-c8e4-4da6-988f-6509d718e6e7 tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] Calling method '.version_select at 0x7faab80b8430>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:21.080144 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b3a0eeaf-c8e4-4da6-988f-6509d718e6e7 tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.204966 Jun 16 14:57:21.090983 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 15/35] 10.222.0.72 () {58 vars in 1169 bytes} [Thu Jun 16 14:57:20 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:21.094433 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ee6f08f3-8c86-44dc-913c-7c32b42a83c0 tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] Calling method '.version_select at 0x7faab782b550>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:21.163578 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-82162acc-6365-45c2-b9b8-a0e6f8425789 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Calling method '.version_select at 0x7faab80c30d0>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:21.390857 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ee6f08f3-8c86-44dc-913c-7c32b42a83c0 tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.300794 Jun 16 14:57:21.395120 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 21/36] 10.222.0.72 () {58 vars in 1154 bytes} [Thu Jun 16 14:57:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:21.425140 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-34fb5391-a366-45f1-9914-43fe511b49ac tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] Calling method '.version_select at 0x7faab80c2160>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:21.491430 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-82162acc-6365-45c2-b9b8-a0e6f8425789 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] HTTP exception thrown: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-82162acc-6365-45c2-b9b8-a0e6f8425789 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Request method failure captured: Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/os-volumes/1e5e3bac-58ef-4420-9e8d-edf783897a5a HTTP/1.1 Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0TB8cQMbdSyuGeYyC1Ol-jRxKg0SwQMxDYm1KcNypP-IZrXyTdAHQCXlQCx__zFIH0XTE8X4fxBF4XZ5hvPeUq04If9pbcqn8aYbvP-BmyH5mcmc8cinGRZclPeR9J7jfAQGbf2lnxuFRLsE7fhZ695WfBItjFmciI_lBPGA-1nPQc Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 1107ea1ea92647f8a961cb49812b53bd Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1409164476 Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 14:57:21.497285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 14:57:21.498385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1107ea1ea92647f8a961cb49812b53bd", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1107ea1ea92647f8a961cb49812b53bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1107ea1ea92647f8a961cb49812b53bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1107ea1ea92647f8a961cb49812b53bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:57:21.498385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1409164476 Jun 16 14:57:21.498385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 1107ea1ea92647f8a961cb49812b53bd Jun 16 14:57:21.498385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1409164476 Jun 16 14:57:21.498385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-VolumesSnapshotsTestJSON-1409164476-project Jun 16 14:57:21.498385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 14:57:21.498385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 14:57:21.498385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: 9ce13f0b56d84e88a611733039534715 Jun 16 14:57:21.498385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1409164476-project Jun 16 14:57:21.498385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: Jun 16 14:57:21.498385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. Jun 16 14:57:21.498385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': '1e5e3bac-58ef-4420-9e8d-edf783897a5a'} Jun 16 14:57:21.498385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:57:21.498996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:21.498996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:57:21.498996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:57:21.498996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 14:57:21.498996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 14:57:21.498996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 14:57:21.498996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 14:57:21.498996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:57:21.498996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:57:21.498996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:57:21.498996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:57:21.498996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:57:21.498996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:57:21.498996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:57:21.498996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:57:21.498996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. (HTTP 404) (Request-ID: req-fd924b44-71cd-4cb6-87b7-e2a37d6424be) Jun 16 14:57:21.498996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.498996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:21.498996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.499860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:21.499860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 14:57:21.499860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 14:57:21.499860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 14:57:21.499860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 14:57:21.499860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 14:57:21.499860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 14:57:21.499860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 14:57:21.499860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 14:57:21.499860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:57:21.499860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:57:21.499860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 14:57:21.499860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 14:57:21.499860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 14:57:21.499860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 14:57:21.499860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:57:21.499860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:57:21.499860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:57:21.499860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:57:21.500708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:57:21.500708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:57:21.500708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:57:21.500708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:57:21.500708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. Jun 16 14:57:21.500708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.500708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:21.500708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.500708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:21.500708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:21.500708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:21.500708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:57:21.500708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:57:21.500708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:57:21.500708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:57:21.500708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:57:21.500708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:57:21.500708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 14:57:21.500708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:57:21.501596 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. Jun 16 14:57:21.501596 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.501596 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:21.501596 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.501596 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:21.501596 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:21.501596 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:21.501596 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:57:21.501596 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:57:21.501596 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. Jun 16 14:57:21.501596 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.507100 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-82162acc-6365-45c2-b9b8-a0e6f8425789 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Returning 404 to user: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:57:21.510221 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-82162acc-6365-45c2-b9b8-a0e6f8425789 tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/1e5e3bac-58ef-4420-9e8d-edf783897a5a" status: 404 len: 109 microversion: 2.1 time: 0.353660 Jun 16 14:57:21.515772 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 16/37] 10.222.0.72 () {58 vars in 1244 bytes} [Thu Jun 16 14:57:21 2022] GET /compute/v2.1/os-volumes/1e5e3bac-58ef-4420-9e8d-edf783897a5a => generated 109 bytes in 360 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:57:21.549065 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-dd713543-1774-4745-be7f-afe861931a6f tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Calling method '.version_select at 0x7faab814e550>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:21.764753 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-dd713543-1774-4745-be7f-afe861931a6f tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] HTTP exception thrown: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-dd713543-1774-4745-be7f-afe861931a6f tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Request method failure captured: Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: DELETE /compute/v2.1/os-volumes/1e5e3bac-58ef-4420-9e8d-edf783897a5a HTTP/1.1 Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0TB8cQMbdSyuGeYyC1Ol-jRxKg0SwQMxDYm1KcNypP-IZrXyTdAHQCXlQCx__zFIH0XTE8X4fxBF4XZ5hvPeUq04If9pbcqn8aYbvP-BmyH5mcmc8cinGRZclPeR9J7jfAQGbf2lnxuFRLsE7fhZ695WfBItjFmciI_lBPGA-1nPQc Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 1107ea1ea92647f8a961cb49812b53bd Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1409164476 Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 14:57:21.766749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 14:57:21.768591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1107ea1ea92647f8a961cb49812b53bd", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1107ea1ea92647f8a961cb49812b53bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1107ea1ea92647f8a961cb49812b53bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1107ea1ea92647f8a961cb49812b53bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:57:21.768591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1409164476 Jun 16 14:57:21.768591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 1107ea1ea92647f8a961cb49812b53bd Jun 16 14:57:21.768591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1409164476 Jun 16 14:57:21.768591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-VolumesSnapshotsTestJSON-1409164476-project Jun 16 14:57:21.768591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 14:57:21.768591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 14:57:21.768591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: 9ce13f0b56d84e88a611733039534715 Jun 16 14:57:21.768591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1409164476-project Jun 16 14:57:21.768591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: Jun 16 14:57:21.768591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. Jun 16 14:57:21.768591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': '1e5e3bac-58ef-4420-9e8d-edf783897a5a'} Jun 16 14:57:21.768591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:57:21.771946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:21.771946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:57:21.771946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:57:21.771946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 14:57:21.771946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 14:57:21.771946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 14:57:21.771946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 14:57:21.771946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 14:57:21.771946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 14:57:21.771946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 14:57:21.771946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 14:57:21.771946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:57:21.771946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:57:21.771946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:57:21.771946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:57:21.771946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. (HTTP 404) (Request-ID: req-161b5f2c-79fa-4bea-a9dd-2fa2fdd2e8e6) Jun 16 14:57:21.771946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.771946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:21.771946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.773591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:21.773591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 14:57:21.773591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 14:57:21.773591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 14:57:21.773591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 14:57:21.773591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 14:57:21.773591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 14:57:21.773591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 14:57:21.773591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 14:57:21.773591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:57:21.773591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:57:21.773591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 14:57:21.773591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 14:57:21.773591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 14:57:21.773591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 14:57:21.773591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 14:57:21.773591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 14:57:21.773591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 14:57:21.773591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 14:57:21.781179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:57:21.781179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:57:21.781179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:57:21.781179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:57:21.781179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. Jun 16 14:57:21.781179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.781179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:21.781179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.781179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:21.781179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:21.781179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:21.781179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:57:21.781179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:57:21.781179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:57:21.781179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:57:21.781179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:57:21.781179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:57:21.781179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 14:57:21.781179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:57:21.782874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. Jun 16 14:57:21.782874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.782874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:21.782874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.782874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:21.782874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:21.782874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:21.782874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:57:21.782874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:57:21.782874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. Jun 16 14:57:21.782874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.782874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-dd713543-1774-4745-be7f-afe861931a6f tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Returning 404 to user: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:57:21.782874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-dd713543-1774-4745-be7f-afe861931a6f tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/1e5e3bac-58ef-4420-9e8d-edf783897a5a" status: 404 len: 109 microversion: 2.1 time: 0.225829 Jun 16 14:57:21.782874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 17/38] 10.222.0.72 () {58 vars in 1247 bytes} [Thu Jun 16 14:57:21 2022] DELETE /compute/v2.1/os-volumes/1e5e3bac-58ef-4420-9e8d-edf783897a5a => generated 109 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:57:21.784159 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-30eea2f1-1686-427b-b7c3-2a9acf66bbee tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Calling method '.version_select at 0x7faab80b84c0>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:21.798001 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-34fb5391-a366-45f1-9914-43fe511b49ac tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.395315 Jun 16 14:57:21.799387 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 22/39] 10.222.0.72 () {58 vars in 1187 bytes} [Thu Jun 16 14:57:21 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:21.814392 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e88f8842-aabd-42cb-a197-a02eceb6cc5e tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] Calling method '.version_select at 0x7faab8128700>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:21.889244 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-30eea2f1-1686-427b-b7c3-2a9acf66bbee tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] HTTP exception thrown: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-30eea2f1-1686-427b-b7c3-2a9acf66bbee tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Request method failure captured: Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/os-volumes/1e5e3bac-58ef-4420-9e8d-edf783897a5a HTTP/1.1 Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0TB8cQMbdSyuGeYyC1Ol-jRxKg0SwQMxDYm1KcNypP-IZrXyTdAHQCXlQCx__zFIH0XTE8X4fxBF4XZ5hvPeUq04If9pbcqn8aYbvP-BmyH5mcmc8cinGRZclPeR9J7jfAQGbf2lnxuFRLsE7fhZ695WfBItjFmciI_lBPGA-1nPQc Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 1107ea1ea92647f8a961cb49812b53bd Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1409164476 Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 14:57:21.893974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 14:57:21.895364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_1107ea1ea92647f8a961cb49812b53bd", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1107ea1ea92647f8a961cb49812b53bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/1107ea1ea92647f8a961cb49812b53bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/1107ea1ea92647f8a961cb49812b53bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:57:21.895364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1409164476 Jun 16 14:57:21.895364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 1107ea1ea92647f8a961cb49812b53bd Jun 16 14:57:21.895364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1409164476 Jun 16 14:57:21.895364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-VolumesSnapshotsTestJSON-1409164476-project Jun 16 14:57:21.895364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 14:57:21.895364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 14:57:21.895364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: 9ce13f0b56d84e88a611733039534715 Jun 16 14:57:21.895364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1409164476-project Jun 16 14:57:21.895364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: Jun 16 14:57:21.895364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. Jun 16 14:57:21.895364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': '1e5e3bac-58ef-4420-9e8d-edf783897a5a'} Jun 16 14:57:21.895364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:57:21.896263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:21.896263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:57:21.896263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:57:21.896263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 14:57:21.896263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 14:57:21.896263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 14:57:21.896263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 14:57:21.896263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:57:21.896263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:57:21.896263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:57:21.896263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:57:21.896263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:57:21.896263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:57:21.896263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:57:21.896263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:57:21.896263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. (HTTP 404) (Request-ID: req-f8812aa0-2513-4d15-ae78-da9f81b7c441) Jun 16 14:57:21.896263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.896263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:21.896263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.897502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:21.897502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 14:57:21.897502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 14:57:21.897502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 14:57:21.897502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 14:57:21.897502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 14:57:21.897502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 14:57:21.897502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 14:57:21.897502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 14:57:21.897502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 14:57:21.897502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 14:57:21.897502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 14:57:21.897502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 14:57:21.897502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 14:57:21.897502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 14:57:21.897502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 14:57:21.897502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 14:57:21.897502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 14:57:21.897502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 14:57:21.898427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 14:57:21.898427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 14:57:21.898427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 14:57:21.898427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 14:57:21.898427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. Jun 16 14:57:21.898427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.898427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:21.898427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.898427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:21.898427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:21.898427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:21.898427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:57:21.898427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:57:21.898427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 14:57:21.898427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 14:57:21.898427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:57:21.898427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:57:21.898427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 14:57:21.898427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:57:21.901662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. Jun 16 14:57:21.901662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.901662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:57:21.901662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.901662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:57:21.901662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:57:21.901662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:57:21.901662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:57:21.901662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:57:21.901662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. Jun 16 14:57:21.901662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:57:21.901662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-30eea2f1-1686-427b-b7c3-2a9acf66bbee tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] Returning 404 to user: Volume 1e5e3bac-58ef-4420-9e8d-edf783897a5a could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:57:21.901662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-30eea2f1-1686-427b-b7c3-2a9acf66bbee tempest-VolumesSnapshotsTestJSON-1409164476 tempest-VolumesSnapshotsTestJSON-1409164476-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/1e5e3bac-58ef-4420-9e8d-edf783897a5a" status: 404 len: 109 microversion: 2.1 time: 0.121603 Jun 16 14:57:21.901662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 18/40] 10.222.0.72 () {58 vars in 1244 bytes} [Thu Jun 16 14:57:21 2022] GET /compute/v2.1/os-volumes/1e5e3bac-58ef-4420-9e8d-edf783897a5a => generated 109 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:57:22.078741 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e88f8842-aabd-42cb-a197-a02eceb6cc5e tempest-VolumesTestJSON-1636600047 tempest-VolumesTestJSON-1636600047-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.269556 Jun 16 14:57:22.079453 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 23/41] 10.222.0.72 () {58 vars in 1154 bytes} [Thu Jun 16 14:57:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:24.090709 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-59715aef-4044-4fff-95b0-a5ed83c6b935 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-693645246", "imageRef": "23371504-a4d6-4064-90b4-87bfd0a15170", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3dc2fbd7-b902-4092-9a0a-ec11d0484649"}], "security_groups": [{"name": "tempest-securitygroup--1713020009"}], "key_name": "tempest-keypair-1006749574", "user_data": "}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:24.280212 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-498a5e9b-aeb2-4f05-99d7-9b0b55c50280 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-527199791", "imageRef": "23371504-a4d6-4064-90b4-87bfd0a15170", "flavorRef": "452", "networks": [{"uuid": "b6f4c40d-6092-40a7-85ed-80fb26ed2561"}]}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:24.552796 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.network.neutron [None req-498a5e9b-aeb2-4f05-99d7-9b0b55c50280 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] validate_networks() for [('b6f4c40d-6092-40a7-85ed-80fb26ed2561', None, None, None, None, None)] {{(pid=124589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:57:24.984971 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-59715aef-4044-4fff-95b0-a5ed83c6b935 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] validate_networks() for [('3dc2fbd7-b902-4092-9a0a-ec11d0484649', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:57:26.126701 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-498a5e9b-aeb2-4f05-99d7-9b0b55c50280 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Flavor limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:57:26.127367 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-498a5e9b-aeb2-4f05-99d7-9b0b55c50280 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Image limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:57:26.127623 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-498a5e9b-aeb2-4f05-99d7-9b0b55c50280 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Flavor pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:57:26.128037 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-498a5e9b-aeb2-4f05-99d7-9b0b55c50280 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Image pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:57:26.128449 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-498a5e9b-aeb2-4f05-99d7-9b0b55c50280 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:57:26.145293 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-498a5e9b-aeb2-4f05-99d7-9b0b55c50280 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:26.145750 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-498a5e9b-aeb2-4f05-99d7-9b0b55c50280 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:26.146558 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-498a5e9b-aeb2-4f05-99d7-9b0b55c50280 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:26.146997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-498a5e9b-aeb2-4f05-99d7-9b0b55c50280 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:26.193961 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-498a5e9b-aeb2-4f05-99d7-9b0b55c50280 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Getting quotas for project a0788d395b4e4632b29e263608e28973. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:57:26.202540 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-498a5e9b-aeb2-4f05-99d7-9b0b55c50280 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Getting quotas for user 1c246b5f70c54d678d827ea43d5c7a38 and project a0788d395b4e4632b29e263608e28973. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:57:26.218253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-498a5e9b-aeb2-4f05-99d7-9b0b55c50280 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Going to run 1 instances... {{(pid=124589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:57:26.221415 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-498a5e9b-aeb2-4f05-99d7-9b0b55c50280 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23371504-a4d6-4064-90b4-87bfd0a15170',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:57:26.397590 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-498a5e9b-aeb2-4f05-99d7-9b0b55c50280 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.875473 Jun 16 14:57:26.405141 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 19/42] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 14:57:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:57:26.657576 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-59715aef-4044-4fff-95b0-a5ed83c6b935 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:57:26.658649 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-59715aef-4044-4fff-95b0-a5ed83c6b935 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:57:26.659332 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-59715aef-4044-4fff-95b0-a5ed83c6b935 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:57:26.660145 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-59715aef-4044-4fff-95b0-a5ed83c6b935 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:57:26.660800 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-59715aef-4044-4fff-95b0-a5ed83c6b935 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:57:26.684437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-59715aef-4044-4fff-95b0-a5ed83c6b935 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:26.685246 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-59715aef-4044-4fff-95b0-a5ed83c6b935 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:26.687473 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-59715aef-4044-4fff-95b0-a5ed83c6b935 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:26.688142 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-59715aef-4044-4fff-95b0-a5ed83c6b935 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:26.737164 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-59715aef-4044-4fff-95b0-a5ed83c6b935 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Getting quotas for project 2a4c67a42f8a405d84d4697a45e962ff. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:57:26.743415 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-59715aef-4044-4fff-95b0-a5ed83c6b935 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Getting quotas for user ba40bcf173404e6c8b17d311b65bf780 and project 2a4c67a42f8a405d84d4697a45e962ff. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:57:26.769364 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-59715aef-4044-4fff-95b0-a5ed83c6b935 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:57:26.778137 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-59715aef-4044-4fff-95b0-a5ed83c6b935 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23371504-a4d6-4064-90b4-87bfd0a15170',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:57:26.971816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-59715aef-4044-4fff-95b0-a5ed83c6b935 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.886984 Jun 16 14:57:26.972481 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 24/43] 10.222.0.72 () {62 vars in 1187 bytes} [Thu Jun 16 14:57:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 2889 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 14:57:27.040243 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9041729f-71ba-49a5-b0c1-7aabfb035f11 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Action: 'create', calling method: .version_select at 0x7faab77c2040>, body: {"keypair": {"name": "tempest-keypair-1473530072", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHOHP6Rwrvnmgu5Pc7JQg0cDy6JHSpbcUeuIS7acuXTIJo5HFVvUpJycis5fFPDwBNVkpIgnib9h4H4Hy5fp6RTFmnbAhKNqYWmphaYqRy9I1SISIfiXO7fXiThNUpDWg=="}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:27.181196 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-9041729f-71ba-49a5-b0c1-7aabfb035f11 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Getting quotas for project 2940b81a86c2401db1aa432d9a0735eb. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:57:27.213811 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-9041729f-71ba-49a5-b0c1-7aabfb035f11 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Getting quotas for user 0b8be0ab53ae48af844bc281dee5f77c and project 2940b81a86c2401db1aa432d9a0735eb. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:57:27.365906 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9041729f-71ba-49a5-b0c1-7aabfb035f11 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.958657 Jun 16 14:57:27.372633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 20/44] 10.222.0.72 () {60 vars in 1158 bytes} [Thu Jun 16 14:57:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:27.411639 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-dcb0873f-1580-4297-8f79-5034dce5a56c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:27.412740 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-dcb0873f-1580-4297-8f79-5034dce5a56c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:27.566373 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-63c9ddb7-a75b-4a2e-bf40-3c4d7ed8011c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-694061739", "imageRef": "23371504-a4d6-4064-90b4-87bfd0a15170", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:27.731517 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-63c9ddb7-a75b-4a2e-bf40-3c4d7ed8011c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] validate_networks() for [('af6393b8-96dc-4031-aeb0-a940bd5ce30c', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:57:28.627424 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-dcb0873f-1580-4297-8f79-5034dce5a56c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:28.660645 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-dcb0873f-1580-4297-8f79-5034dce5a56c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1214 microversion: 2.1 time: 1.285960 Jun 16 14:57:28.665619 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 21/45] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:27 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1214 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:28.680540 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ade02da5-00fd-4fbe-b610-a3529f771368 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:28.681537 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ade02da5-00fd-4fbe-b610-a3529f771368 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:28.975730 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ade02da5-00fd-4fbe-b610-a3529f771368 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:29.002815 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ade02da5-00fd-4fbe-b610-a3529f771368 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:29.008958 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ade02da5-00fd-4fbe-b610-a3529f771368 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:29.019618 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ade02da5-00fd-4fbe-b610-a3529f771368 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1281 microversion: 2.20 time: 0.345636 Jun 16 14:57:29.025204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 22/46] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:28 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1281 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:57:29.243682 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-63c9ddb7-a75b-4a2e-bf40-3c4d7ed8011c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:57:29.244121 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-63c9ddb7-a75b-4a2e-bf40-3c4d7ed8011c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:57:29.244669 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-63c9ddb7-a75b-4a2e-bf40-3c4d7ed8011c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:57:29.245299 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-63c9ddb7-a75b-4a2e-bf40-3c4d7ed8011c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:57:29.245751 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-63c9ddb7-a75b-4a2e-bf40-3c4d7ed8011c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:57:29.268597 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63c9ddb7-a75b-4a2e-bf40-3c4d7ed8011c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:29.269083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63c9ddb7-a75b-4a2e-bf40-3c4d7ed8011c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:29.269889 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63c9ddb7-a75b-4a2e-bf40-3c4d7ed8011c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:29.270334 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63c9ddb7-a75b-4a2e-bf40-3c4d7ed8011c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:29.368928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-63c9ddb7-a75b-4a2e-bf40-3c4d7ed8011c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Getting quotas for project b017c2881aba4df6afe70cdcb84d5ee8. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:57:29.394595 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-63c9ddb7-a75b-4a2e-bf40-3c4d7ed8011c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Getting quotas for user 73a51a4e876e4910bbc5dd69f8a18058 and project b017c2881aba4df6afe70cdcb84d5ee8. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:57:29.437624 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-63c9ddb7-a75b-4a2e-bf40-3c4d7ed8011c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:57:29.460588 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-63c9ddb7-a75b-4a2e-bf40-3c4d7ed8011c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23371504-a4d6-4064-90b4-87bfd0a15170',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:57:29.646006 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-63c9ddb7-a75b-4a2e-bf40-3c4d7ed8011c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.672103 Jun 16 14:57:29.646698 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 25/47] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 14:57:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 2674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:57:29.662160 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f99420ad-57d4-459d-b6a5-f4d1169a8c87 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:29.664232 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f99420ad-57d4-459d-b6a5-f4d1169a8c87 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:29.683693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-583df068-9805-4d5c-bba1-0d78a29ca608 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:29.684323 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-583df068-9805-4d5c-bba1-0d78a29ca608 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:29.960650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f99420ad-57d4-459d-b6a5-f4d1169a8c87 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:29.972636 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f99420ad-57d4-459d-b6a5-f4d1169a8c87 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1221 microversion: 2.1 time: 0.318616 Jun 16 14:57:29.974146 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 23/48] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:29 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1221 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:30.044276 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-22fc21bb-610a-4e44-8fff-75cf7834d33d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:30.045389 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-22fc21bb-610a-4e44-8fff-75cf7834d33d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:30.077345 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-583df068-9805-4d5c-bba1-0d78a29ca608 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:30.146901 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-583df068-9805-4d5c-bba1-0d78a29ca608 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1214 microversion: 2.1 time: 0.465900 Jun 16 14:57:30.152349 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 26/49] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:29 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1214 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:30.286716 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-22fc21bb-610a-4e44-8fff-75cf7834d33d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:30.298009 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-22fc21bb-610a-4e44-8fff-75cf7834d33d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:30.299829 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-22fc21bb-610a-4e44-8fff-75cf7834d33d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:30.301098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-22fc21bb-610a-4e44-8fff-75cf7834d33d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1281 microversion: 2.20 time: 0.262135 Jun 16 14:57:30.310251 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 24/50] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:30 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1281 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:57:30.779333 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f5761cb0-c9db-4d98-8e8c-c0324f1d14d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1939193651", "imageRef": "23371504-a4d6-4064-90b4-87bfd0a15170", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:31.018641 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-f5761cb0-c9db-4d98-8e8c-c0324f1d14d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] validate_networks() for [('af6393b8-96dc-4031-aeb0-a940bd5ce30c', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:57:31.172646 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5efb33b3-f5e8-4baf-ad83-0e0ec4b2855a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:31.173690 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5efb33b3-f5e8-4baf-ad83-0e0ec4b2855a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:31.209078 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5efb33b3-f5e8-4baf-ad83-0e0ec4b2855a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:31.231073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5efb33b3-f5e8-4baf-ad83-0e0ec4b2855a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:31.231950 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5efb33b3-f5e8-4baf-ad83-0e0ec4b2855a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:31.232411 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5efb33b3-f5e8-4baf-ad83-0e0ec4b2855a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:32.209075 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5efb33b3-f5e8-4baf-ad83-0e0ec4b2855a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:32.256006 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5efb33b3-f5e8-4baf-ad83-0e0ec4b2855a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1210 microversion: 2.1 time: 1.093439 Jun 16 14:57:32.256719 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 25/51] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:31 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1210 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:32.270427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5c94149b-8c56-4e31-95e5-a070781187d0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:32.271053 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5c94149b-8c56-4e31-95e5-a070781187d0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:32.304341 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c94149b-8c56-4e31-95e5-a070781187d0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:32.308062 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c94149b-8c56-4e31-95e5-a070781187d0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:32.310503 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c94149b-8c56-4e31-95e5-a070781187d0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:32.316945 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c94149b-8c56-4e31-95e5-a070781187d0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:32.599708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-f5761cb0-c9db-4d98-8e8c-c0324f1d14d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:57:32.600806 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-f5761cb0-c9db-4d98-8e8c-c0324f1d14d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:57:32.601548 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-f5761cb0-c9db-4d98-8e8c-c0324f1d14d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:57:32.602519 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-f5761cb0-c9db-4d98-8e8c-c0324f1d14d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:57:32.603257 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-f5761cb0-c9db-4d98-8e8c-c0324f1d14d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:57:32.633257 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5761cb0-c9db-4d98-8e8c-c0324f1d14d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:32.635445 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5761cb0-c9db-4d98-8e8c-c0324f1d14d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:32.640503 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5761cb0-c9db-4d98-8e8c-c0324f1d14d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:32.641312 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5761cb0-c9db-4d98-8e8c-c0324f1d14d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:32.712056 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-f5761cb0-c9db-4d98-8e8c-c0324f1d14d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Getting quotas for project b017c2881aba4df6afe70cdcb84d5ee8. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:57:32.718736 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-f5761cb0-c9db-4d98-8e8c-c0324f1d14d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Getting quotas for user 73a51a4e876e4910bbc5dd69f8a18058 and project b017c2881aba4df6afe70cdcb84d5ee8. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:57:32.754065 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f5761cb0-c9db-4d98-8e8c-c0324f1d14d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:57:32.756996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f5761cb0-c9db-4d98-8e8c-c0324f1d14d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23371504-a4d6-4064-90b4-87bfd0a15170',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:57:32.796165 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5c94149b-8c56-4e31-95e5-a070781187d0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:32.814094 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5c94149b-8c56-4e31-95e5-a070781187d0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:32.822084 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5c94149b-8c56-4e31-95e5-a070781187d0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:32.826604 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5c94149b-8c56-4e31-95e5-a070781187d0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1333 microversion: 2.20 time: 0.568010 Jun 16 14:57:32.829925 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 26/52] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:32 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1333 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:57:32.850131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f5761cb0-c9db-4d98-8e8c-c0324f1d14d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.074944 Jun 16 14:57:32.855086 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 27/53] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 14:57:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 2081 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:57:32.867767 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f4b53d76-180e-4e85-97bd-e41152052ea3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:32.868288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f4b53d76-180e-4e85-97bd-e41152052ea3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:33.034668 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f4b53d76-180e-4e85-97bd-e41152052ea3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:33.045296 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f4b53d76-180e-4e85-97bd-e41152052ea3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1222 microversion: 2.1 time: 0.182199 Jun 16 14:57:33.048328 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 27/54] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:32 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1222 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:33.283254 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d7950f45-fb96-4535-9e56-56db2efe07cc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:33.284186 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d7950f45-fb96-4535-9e56-56db2efe07cc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:33.293440 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7950f45-fb96-4535-9e56-56db2efe07cc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:33.305110 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7950f45-fb96-4535-9e56-56db2efe07cc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:33.306239 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7950f45-fb96-4535-9e56-56db2efe07cc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:33.307502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7950f45-fb96-4535-9e56-56db2efe07cc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:33.849820 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-bf843936-468e-4fa4-a612-66144c44de1b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:33.851247 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-bf843936-468e-4fa4-a612-66144c44de1b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:33.865019 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bf843936-468e-4fa4-a612-66144c44de1b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:33.865962 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bf843936-468e-4fa4-a612-66144c44de1b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:33.867392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bf843936-468e-4fa4-a612-66144c44de1b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:33.868096 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bf843936-468e-4fa4-a612-66144c44de1b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:34.383159 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bf843936-468e-4fa4-a612-66144c44de1b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:34.404730 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bf843936-468e-4fa4-a612-66144c44de1b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:34.409354 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bf843936-468e-4fa4-a612-66144c44de1b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:34.410877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-bf843936-468e-4fa4-a612-66144c44de1b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1351 microversion: 2.20 time: 0.565080 Jun 16 14:57:34.419958 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 28/55] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:33 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1351 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:57:34.425827 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2fef5d9b-7187-4bdc-8599-d6d23b40a4bb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:34.449534 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2fef5d9b-7187-4bdc-8599-d6d23b40a4bb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:34.487797 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2fef5d9b-7187-4bdc-8599-d6d23b40a4bb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:34.491219 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2fef5d9b-7187-4bdc-8599-d6d23b40a4bb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:34.500404 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2fef5d9b-7187-4bdc-8599-d6d23b40a4bb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:34.501194 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2fef5d9b-7187-4bdc-8599-d6d23b40a4bb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:34.510855 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d7950f45-fb96-4535-9e56-56db2efe07cc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:34.533666 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d7950f45-fb96-4535-9e56-56db2efe07cc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1266 microversion: 2.1 time: 1.254136 Jun 16 14:57:34.542501 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 28/56] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:33 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1266 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:34.801106 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2fef5d9b-7187-4bdc-8599-d6d23b40a4bb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:34.887999 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2fef5d9b-7187-4bdc-8599-d6d23b40a4bb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1218 microversion: 2.1 time: 0.437509 Jun 16 14:57:34.891337 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 29/57] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:34 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1218 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:35.274252 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-be679a34-c678-42a2-861d-8c2cb3570e6a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-845436738", "imageRef": "23371504-a4d6-4064-90b4-87bfd0a15170", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "585283c3-d940-441f-ba61-bbe0dfecbee8"}], "security_groups": [{"name": "tempest-securitygroup--1255277063"}], "key_name": "tempest-keypair-1473530072", "user_data": "}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:35.438496 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e92e72f8-4107-4b35-bec1-31fa1c0e81a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:35.439117 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e92e72f8-4107-4b35-bec1-31fa1c0e81a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:35.451744 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e92e72f8-4107-4b35-bec1-31fa1c0e81a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:35.452205 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e92e72f8-4107-4b35-bec1-31fa1c0e81a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:35.457213 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e92e72f8-4107-4b35-bec1-31fa1c0e81a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:35.459314 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e92e72f8-4107-4b35-bec1-31fa1c0e81a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:35.892145 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e92e72f8-4107-4b35-bec1-31fa1c0e81a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:35.928727 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e92e72f8-4107-4b35-bec1-31fa1c0e81a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:35.930623 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e92e72f8-4107-4b35-bec1-31fa1c0e81a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:35.934773 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e92e72f8-4107-4b35-bec1-31fa1c0e81a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1339 microversion: 2.20 time: 0.500998 Jun 16 14:57:35.935550 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 30/58] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:35 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1339 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:57:35.953716 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-bbfc3f33-7bcc-4a9c-8aa4-76391278093c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:35.959655 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-bbfc3f33-7bcc-4a9c-8aa4-76391278093c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:35.977915 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bbfc3f33-7bcc-4a9c-8aa4-76391278093c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:35.978382 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bbfc3f33-7bcc-4a9c-8aa4-76391278093c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:35.983234 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bbfc3f33-7bcc-4a9c-8aa4-76391278093c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:35.983700 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bbfc3f33-7bcc-4a9c-8aa4-76391278093c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:36.170302 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:36.257588 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bbfc3f33-7bcc-4a9c-8aa4-76391278093c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:36.271323 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-bbfc3f33-7bcc-4a9c-8aa4-76391278093c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1272 microversion: 2.1 time: 0.325640 Jun 16 14:57:36.280260 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 31/59] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:35 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1272 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:36.321964 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f63a6fa1-c035-45ac-a236-523a16b5ba91 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:36.325610 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f63a6fa1-c035-45ac-a236-523a16b5ba91 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:36.372515 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f63a6fa1-c035-45ac-a236-523a16b5ba91 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:36.373151 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f63a6fa1-c035-45ac-a236-523a16b5ba91 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:36.374187 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f63a6fa1-c035-45ac-a236-523a16b5ba91 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:36.377843 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f63a6fa1-c035-45ac-a236-523a16b5ba91 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:36.972856 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f63a6fa1-c035-45ac-a236-523a16b5ba91 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:36.981699 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f63a6fa1-c035-45ac-a236-523a16b5ba91 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1280 microversion: 2.1 time: 0.690982 Jun 16 14:57:36.982278 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 32/60] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:36 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1280 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:37.027743 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7d3ad4b4-fd71-4cd4-a86e-ec5e85760c0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:37.032707 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7d3ad4b4-fd71-4cd4-a86e-ec5e85760c0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:37.069970 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7d3ad4b4-fd71-4cd4-a86e-ec5e85760c0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:37.070792 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7d3ad4b4-fd71-4cd4-a86e-ec5e85760c0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:37.074910 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7d3ad4b4-fd71-4cd4-a86e-ec5e85760c0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:37.077221 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7d3ad4b4-fd71-4cd4-a86e-ec5e85760c0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:37.423512 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7d3ad4b4-fd71-4cd4-a86e-ec5e85760c0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:37.450361 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7d3ad4b4-fd71-4cd4-a86e-ec5e85760c0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:37.458665 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7d3ad4b4-fd71-4cd4-a86e-ec5e85760c0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:37.472168 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7d3ad4b4-fd71-4cd4-a86e-ec5e85760c0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1339 microversion: 2.20 time: 0.478138 Jun 16 14:57:37.481056 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 33/61] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:36 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1339 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:57:37.513295 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f178c857-7c4a-4fb9-b02b-4333df2e53d1 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:37.519121 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f178c857-7c4a-4fb9-b02b-4333df2e53d1 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:37.542827 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f178c857-7c4a-4fb9-b02b-4333df2e53d1 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:37.544705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f178c857-7c4a-4fb9-b02b-4333df2e53d1 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:37.545559 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f178c857-7c4a-4fb9-b02b-4333df2e53d1 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:37.546049 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f178c857-7c4a-4fb9-b02b-4333df2e53d1 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:38.690908 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-be679a34-c678-42a2-861d-8c2cb3570e6a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] validate_networks() for [('585283c3-d940-441f-ba61-bbe0dfecbee8', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:57:39.023779 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f178c857-7c4a-4fb9-b02b-4333df2e53d1 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:39.067011 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f178c857-7c4a-4fb9-b02b-4333df2e53d1 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 1.564515 Jun 16 14:57:39.068359 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 34/62] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:37 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:39.096897 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d2a993f7-2821-4252-ac0b-6b79eeeafade tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:39.099400 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d2a993f7-2821-4252-ac0b-6b79eeeafade tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:39.156009 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d2a993f7-2821-4252-ac0b-6b79eeeafade tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:39.157137 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d2a993f7-2821-4252-ac0b-6b79eeeafade tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:39.160473 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d2a993f7-2821-4252-ac0b-6b79eeeafade tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:39.163417 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d2a993f7-2821-4252-ac0b-6b79eeeafade tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:39.695395 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d2a993f7-2821-4252-ac0b-6b79eeeafade tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:39.739560 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d2a993f7-2821-4252-ac0b-6b79eeeafade tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1280 microversion: 2.1 time: 0.668220 Jun 16 14:57:39.740402 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 35/63] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:39 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1280 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:39.756777 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-254fe85d-73a8-4dd1-a897-d96ba55f864d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:39.759681 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-254fe85d-73a8-4dd1-a897-d96ba55f864d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:39.797753 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-254fe85d-73a8-4dd1-a897-d96ba55f864d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:39.802923 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-254fe85d-73a8-4dd1-a897-d96ba55f864d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:39.803843 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-254fe85d-73a8-4dd1-a897-d96ba55f864d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:39.807263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-254fe85d-73a8-4dd1-a897-d96ba55f864d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:40.960351 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-254fe85d-73a8-4dd1-a897-d96ba55f864d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:40.973237 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-254fe85d-73a8-4dd1-a897-d96ba55f864d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:40.976278 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-254fe85d-73a8-4dd1-a897-d96ba55f864d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:40.996353 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-254fe85d-73a8-4dd1-a897-d96ba55f864d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 1.254119 Jun 16 14:57:41.001065 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 36/64] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:39 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:57:41.017677 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2a955c34-3a9d-49a7-9a63-7bd332a7eb76 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:41.018279 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2a955c34-3a9d-49a7-9a63-7bd332a7eb76 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:41.070978 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a955c34-3a9d-49a7-9a63-7bd332a7eb76 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:41.071437 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a955c34-3a9d-49a7-9a63-7bd332a7eb76 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:41.072281 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a955c34-3a9d-49a7-9a63-7bd332a7eb76 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:41.072753 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a955c34-3a9d-49a7-9a63-7bd332a7eb76 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:41.640054 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2a955c34-3a9d-49a7-9a63-7bd332a7eb76 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:41.672537 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2a955c34-3a9d-49a7-9a63-7bd332a7eb76 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.660706 Jun 16 14:57:41.680717 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 37/65] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:41 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:41.716130 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-09120d06-b76a-4da8-900a-622d3cce63dc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:41.717602 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-09120d06-b76a-4da8-900a-622d3cce63dc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:41.733413 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-09120d06-b76a-4da8-900a-622d3cce63dc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:41.734560 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-09120d06-b76a-4da8-900a-622d3cce63dc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:41.736457 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-09120d06-b76a-4da8-900a-622d3cce63dc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:41.748207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-09120d06-b76a-4da8-900a-622d3cce63dc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:42.295340 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-09120d06-b76a-4da8-900a-622d3cce63dc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:42.321360 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-09120d06-b76a-4da8-900a-622d3cce63dc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1280 microversion: 2.1 time: 0.622550 Jun 16 14:57:42.324621 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 38/66] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:41 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1280 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:42.340497 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b87d60d2-b5d2-46e3-9c52-c0966a6230ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:42.342996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b87d60d2-b5d2-46e3-9c52-c0966a6230ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:42.363612 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b87d60d2-b5d2-46e3-9c52-c0966a6230ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:42.366138 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b87d60d2-b5d2-46e3-9c52-c0966a6230ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:42.371186 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b87d60d2-b5d2-46e3-9c52-c0966a6230ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:42.373617 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b87d60d2-b5d2-46e3-9c52-c0966a6230ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:42.673626 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=6 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:42.731259 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=24 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:42.781380 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b87d60d2-b5d2-46e3-9c52-c0966a6230ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:42.800854 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b87d60d2-b5d2-46e3-9c52-c0966a6230ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:42.804687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b87d60d2-b5d2-46e3-9c52-c0966a6230ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:42.811541 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b87d60d2-b5d2-46e3-9c52-c0966a6230ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.484756 Jun 16 14:57:42.814952 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 39/67] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:42 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:57:42.830865 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0dcd696f-6ef4-4169-82a8-f9beb6aff847 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:42.835057 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0dcd696f-6ef4-4169-82a8-f9beb6aff847 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:42.857066 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0dcd696f-6ef4-4169-82a8-f9beb6aff847 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:42.861252 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0dcd696f-6ef4-4169-82a8-f9beb6aff847 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:42.863879 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0dcd696f-6ef4-4169-82a8-f9beb6aff847 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:42.865627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0dcd696f-6ef4-4169-82a8-f9beb6aff847 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:43.042434 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=20 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:43.914559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-be679a34-c678-42a2-861d-8c2cb3570e6a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:57:43.915837 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-be679a34-c678-42a2-861d-8c2cb3570e6a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:57:43.916708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-be679a34-c678-42a2-861d-8c2cb3570e6a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:57:43.917521 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-be679a34-c678-42a2-861d-8c2cb3570e6a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:57:43.918472 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-be679a34-c678-42a2-861d-8c2cb3570e6a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:57:43.948176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-be679a34-c678-42a2-861d-8c2cb3570e6a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:43.952497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-be679a34-c678-42a2-861d-8c2cb3570e6a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:43.956649 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-be679a34-c678-42a2-861d-8c2cb3570e6a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:43.958967 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-be679a34-c678-42a2-861d-8c2cb3570e6a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:44.095671 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-be679a34-c678-42a2-861d-8c2cb3570e6a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Getting quotas for project 2940b81a86c2401db1aa432d9a0735eb. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:57:44.129501 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-be679a34-c678-42a2-861d-8c2cb3570e6a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Getting quotas for user 0b8be0ab53ae48af844bc281dee5f77c and project 2940b81a86c2401db1aa432d9a0735eb. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:57:44.202182 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-be679a34-c678-42a2-861d-8c2cb3570e6a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:57:44.213608 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-be679a34-c678-42a2-861d-8c2cb3570e6a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23371504-a4d6-4064-90b4-87bfd0a15170',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:57:44.397216 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-be679a34-c678-42a2-861d-8c2cb3570e6a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 9.130058 Jun 16 14:57:44.404018 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 29/68] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 14:57:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 9137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:57:44.442306 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7366f493-f7ca-4ff0-b705-f6715511b619 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:44.443497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7366f493-f7ca-4ff0-b705-f6715511b619 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:44.495392 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7366f493-f7ca-4ff0-b705-f6715511b619 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:44.496031 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7366f493-f7ca-4ff0-b705-f6715511b619 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:44.497135 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7366f493-f7ca-4ff0-b705-f6715511b619 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:44.502868 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7366f493-f7ca-4ff0-b705-f6715511b619 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:45.083610 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0dcd696f-6ef4-4169-82a8-f9beb6aff847 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:45.099654 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0dcd696f-6ef4-4169-82a8-f9beb6aff847 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 2.282016 Jun 16 14:57:45.104929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 40/69] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:42 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 2289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:45.115692 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6ac8c250-1cf8-4ed9-ad3c-1d0745691cd5 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:45.117708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6ac8c250-1cf8-4ed9-ad3c-1d0745691cd5 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:45.150669 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6ac8c250-1cf8-4ed9-ad3c-1d0745691cd5 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:45.153306 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6ac8c250-1cf8-4ed9-ad3c-1d0745691cd5 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:45.158794 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6ac8c250-1cf8-4ed9-ad3c-1d0745691cd5 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:45.160156 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6ac8c250-1cf8-4ed9-ad3c-1d0745691cd5 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:45.730406 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6ac8c250-1cf8-4ed9-ad3c-1d0745691cd5 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:45.740893 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6ac8c250-1cf8-4ed9-ad3c-1d0745691cd5 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:45.743045 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6ac8c250-1cf8-4ed9-ad3c-1d0745691cd5 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:45.745458 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6ac8c250-1cf8-4ed9-ad3c-1d0745691cd5 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.639261 Jun 16 14:57:45.751583 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 41/70] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:45 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:57:45.757350 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ecc911bc-3845-4957-b6ca-2e7964d12986 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:45.758295 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ecc911bc-3845-4957-b6ca-2e7964d12986 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:45.763179 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7366f493-f7ca-4ff0-b705-f6715511b619 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:45.772731 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ecc911bc-3845-4957-b6ca-2e7964d12986 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:45.773866 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ecc911bc-3845-4957-b6ca-2e7964d12986 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:45.774940 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ecc911bc-3845-4957-b6ca-2e7964d12986 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:45.775527 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7366f493-f7ca-4ff0-b705-f6715511b619 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 1.355046 Jun 16 14:57:45.776000 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ecc911bc-3845-4957-b6ca-2e7964d12986 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:45.777325 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 30/71] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:44 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:45.782397 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:45.930778 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ecc911bc-3845-4957-b6ca-2e7964d12986 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:45.950973 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ecc911bc-3845-4957-b6ca-2e7964d12986 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1245 microversion: 2.1 time: 0.193115 Jun 16 14:57:45.952128 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 42/72] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:45 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1245 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:46.117362 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0c3d0d50-d43f-4832-862a-97f2cb5553b2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:46.118590 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0c3d0d50-d43f-4832-862a-97f2cb5553b2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:46.126943 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:46.140116 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c3d0d50-d43f-4832-862a-97f2cb5553b2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:46.140522 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c3d0d50-d43f-4832-862a-97f2cb5553b2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:46.142529 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c3d0d50-d43f-4832-862a-97f2cb5553b2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:46.142701 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c3d0d50-d43f-4832-862a-97f2cb5553b2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:46.224675 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-2058fd4f-9d64-4545-b826-4786346ff4f3 req-200c81c5-1320-4026-88c6-1a81ff02a22f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9", "tag": "4a15d94a-43cc-45b4-89d5-3b8cdc6c8c65"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:46.250749 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-2058fd4f-9d64-4545-b826-4786346ff4f3 req-200c81c5-1320-4026-88c6-1a81ff02a22f service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:46.251206 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-2058fd4f-9d64-4545-b826-4786346ff4f3 req-200c81c5-1320-4026-88c6-1a81ff02a22f service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:46.275998 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-2058fd4f-9d64-4545-b826-4786346ff4f3 req-200c81c5-1320-4026-88c6-1a81ff02a22f service nova] Creating event network-changed:4a15d94a-43cc-45b4-89d5-3b8cdc6c8c65 for instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 on hv-cinder-83716 Jun 16 14:57:46.276964 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-2058fd4f-9d64-4545-b826-4786346ff4f3 req-200c81c5-1320-4026-88c6-1a81ff02a22f service nova] Acquired lock "compute-rpcapi-router" {{(pid=124590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 14:57:46.278194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2300a7bd-0020-43da-a0d1-65cde5a20c45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:46.278950 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2300a7bd-0020-43da-a0d1-65cde5a20c45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:46.279957 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2300a7bd-0020-43da-a0d1-65cde5a20c45 None None] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:46.280613 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2300a7bd-0020-43da-a0d1-65cde5a20c45 None None] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:46.294636 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.compute.rpcapi [None req-2300a7bd-0020-43da-a0d1-65cde5a20c45 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 14:57:46.295587 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2300a7bd-0020-43da-a0d1-65cde5a20c45 None None] Releasing lock "compute-rpcapi-router" {{(pid=124590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 14:57:46.365525 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2300a7bd-0020-43da-a0d1-65cde5a20c45 None None] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.584019 Jun 16 14:57:46.366135 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 31/73] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 14:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:46.536651 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0c3d0d50-d43f-4832-862a-97f2cb5553b2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:46.564910 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0c3d0d50-d43f-4832-862a-97f2cb5553b2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.451264 Jun 16 14:57:46.576628 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 43/74] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:46 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:46.771460 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-85bf8723-83b4-4fd0-8a81-56b4ac2d1131 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:46.773516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-85bf8723-83b4-4fd0-8a81-56b4ac2d1131 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:46.790591 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85bf8723-83b4-4fd0-8a81-56b4ac2d1131 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:46.791988 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85bf8723-83b4-4fd0-8a81-56b4ac2d1131 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:46.793250 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85bf8723-83b4-4fd0-8a81-56b4ac2d1131 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:46.794261 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85bf8723-83b4-4fd0-8a81-56b4ac2d1131 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:46.794524 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-49edc7dc-6872-4318-937f-4e61eb169f90 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:46.795143 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-49edc7dc-6872-4318-937f-4e61eb169f90 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:46.803545 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-49edc7dc-6872-4318-937f-4e61eb169f90 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:46.806309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-49edc7dc-6872-4318-937f-4e61eb169f90 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:46.825264 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-49edc7dc-6872-4318-937f-4e61eb169f90 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:46.825789 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-49edc7dc-6872-4318-937f-4e61eb169f90 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:47.012905 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-49edc7dc-6872-4318-937f-4e61eb169f90 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:47.024959 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-49edc7dc-6872-4318-937f-4e61eb169f90 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.234598 Jun 16 14:57:47.027098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 44/75] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:46 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:47.184693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-85bf8723-83b4-4fd0-8a81-56b4ac2d1131 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:47.207648 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-85bf8723-83b4-4fd0-8a81-56b4ac2d1131 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:47.211099 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-85bf8723-83b4-4fd0-8a81-56b4ac2d1131 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:47.212670 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-85bf8723-83b4-4fd0-8a81-56b4ac2d1131 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.448107 Jun 16 14:57:47.215437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 32/76] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:46 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:57:47.228280 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-af231d00-14b0-4dcc-8e16-d8081a9fd0e6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:47.230864 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-af231d00-14b0-4dcc-8e16-d8081a9fd0e6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:47.237720 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=13 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:47.239777 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-af231d00-14b0-4dcc-8e16-d8081a9fd0e6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:47.240248 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-af231d00-14b0-4dcc-8e16-d8081a9fd0e6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:47.241294 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-af231d00-14b0-4dcc-8e16-d8081a9fd0e6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:47.241734 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-af231d00-14b0-4dcc-8e16-d8081a9fd0e6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:47.246148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-91f524b1-10e2-4c6e-af98-d0c11220da60 req-793f481c-619e-493f-9ffc-9634b8b17dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd17881d-ac5f-44ca-a709-a52350a37a18", "tag": "644ccac5-3aa8-48a4-a0e4-484eabb05969"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:47.264051 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-91f524b1-10e2-4c6e-af98-d0c11220da60 req-793f481c-619e-493f-9ffc-9634b8b17dd5 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:47.265157 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-91f524b1-10e2-4c6e-af98-d0c11220da60 req-793f481c-619e-493f-9ffc-9634b8b17dd5 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:47.292142 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-91f524b1-10e2-4c6e-af98-d0c11220da60 req-793f481c-619e-493f-9ffc-9634b8b17dd5 service nova] Creating event network-changed:644ccac5-3aa8-48a4-a0e4-484eabb05969 for instance fd17881d-ac5f-44ca-a709-a52350a37a18 on hv-cinder-83716 Jun 16 14:57:47.293113 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-91f524b1-10e2-4c6e-af98-d0c11220da60 req-793f481c-619e-493f-9ffc-9634b8b17dd5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 14:57:47.294586 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-019bd961-0042-4b36-aadc-87d3bfd57f21 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:47.295307 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-019bd961-0042-4b36-aadc-87d3bfd57f21 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:47.296457 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-019bd961-0042-4b36-aadc-87d3bfd57f21 None None] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:47.297204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-019bd961-0042-4b36-aadc-87d3bfd57f21 None None] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:47.310257 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.compute.rpcapi [None req-019bd961-0042-4b36-aadc-87d3bfd57f21 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 14:57:47.311909 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-019bd961-0042-4b36-aadc-87d3bfd57f21 None None] Releasing lock "compute-rpcapi-router" {{(pid=124589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 14:57:47.334048 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-019bd961-0042-4b36-aadc-87d3bfd57f21 None None] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.304770 Jun 16 14:57:47.335300 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 45/77] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 14:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:57:47.368901 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-af231d00-14b0-4dcc-8e16-d8081a9fd0e6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:47.382875 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-af231d00-14b0-4dcc-8e16-d8081a9fd0e6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1245 microversion: 2.1 time: 0.163569 Jun 16 14:57:47.386453 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 33/78] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:47 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1245 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:47.586582 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9ec62bae-0815-441d-b0ba-3c1c536cd589 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:47.587338 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9ec62bae-0815-441d-b0ba-3c1c536cd589 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:47.594565 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ec62bae-0815-441d-b0ba-3c1c536cd589 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:47.600935 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ec62bae-0815-441d-b0ba-3c1c536cd589 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:47.602040 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ec62bae-0815-441d-b0ba-3c1c536cd589 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:47.602802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ec62bae-0815-441d-b0ba-3c1c536cd589 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:47.842849 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9ec62bae-0815-441d-b0ba-3c1c536cd589 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:47.854416 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9ec62bae-0815-441d-b0ba-3c1c536cd589 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.275716 Jun 16 14:57:47.855009 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 46/79] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:47 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:48.042642 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-892da59a-d03a-45f6-92b8-131284731b5a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:48.043261 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-892da59a-d03a-45f6-92b8-131284731b5a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:48.049590 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-892da59a-d03a-45f6-92b8-131284731b5a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:48.050054 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-892da59a-d03a-45f6-92b8-131284731b5a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:48.050868 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-892da59a-d03a-45f6-92b8-131284731b5a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:48.051287 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-892da59a-d03a-45f6-92b8-131284731b5a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:48.198591 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-892da59a-d03a-45f6-92b8-131284731b5a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:48.208743 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-892da59a-d03a-45f6-92b8-131284731b5a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.169807 Jun 16 14:57:48.209678 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 34/80] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:48 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:48.237686 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f0f9a2be-a065-496e-b5d0-29f30202b94c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:48.238576 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f0f9a2be-a065-496e-b5d0-29f30202b94c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:48.256228 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0f9a2be-a065-496e-b5d0-29f30202b94c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:48.258861 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0f9a2be-a065-496e-b5d0-29f30202b94c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:48.260005 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0f9a2be-a065-496e-b5d0-29f30202b94c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:48.260985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0f9a2be-a065-496e-b5d0-29f30202b94c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:48.407467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9df49384-f429-495b-835e-1f8e7b54867e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:48.408345 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9df49384-f429-495b-835e-1f8e7b54867e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:48.422187 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9df49384-f429-495b-835e-1f8e7b54867e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:48.422638 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9df49384-f429-495b-835e-1f8e7b54867e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:48.425872 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9df49384-f429-495b-835e-1f8e7b54867e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:48.426333 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9df49384-f429-495b-835e-1f8e7b54867e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:48.434183 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f0f9a2be-a065-496e-b5d0-29f30202b94c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:48.448965 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f0f9a2be-a065-496e-b5d0-29f30202b94c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:48.450721 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f0f9a2be-a065-496e-b5d0-29f30202b94c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:48.451885 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f0f9a2be-a065-496e-b5d0-29f30202b94c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.218447 Jun 16 14:57:48.452436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 47/81] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:48 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:57:48.530806 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9df49384-f429-495b-835e-1f8e7b54867e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:48.538446 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9df49384-f429-495b-835e-1f8e7b54867e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1245 microversion: 2.1 time: 0.137045 Jun 16 14:57:48.539021 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 35/82] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:48 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1245 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:48.878482 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-277755aa-7ea6-4788-93af-aa7a7f75c4d6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:48.879348 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-277755aa-7ea6-4788-93af-aa7a7f75c4d6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:48.898092 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-277755aa-7ea6-4788-93af-aa7a7f75c4d6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:48.898552 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-277755aa-7ea6-4788-93af-aa7a7f75c4d6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:48.899342 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-277755aa-7ea6-4788-93af-aa7a7f75c4d6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:48.899784 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-277755aa-7ea6-4788-93af-aa7a7f75c4d6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:49.054652 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-277755aa-7ea6-4788-93af-aa7a7f75c4d6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:49.063295 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-277755aa-7ea6-4788-93af-aa7a7f75c4d6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.195087 Jun 16 14:57:49.063875 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 48/83] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:48 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:49.226211 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1bc1fd31-10d9-47b7-98a3-13d542b7a45f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:49.226840 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1bc1fd31-10d9-47b7-98a3-13d542b7a45f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:49.233419 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1bc1fd31-10d9-47b7-98a3-13d542b7a45f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:49.234219 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1bc1fd31-10d9-47b7-98a3-13d542b7a45f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:49.234640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1bc1fd31-10d9-47b7-98a3-13d542b7a45f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:49.235094 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1bc1fd31-10d9-47b7-98a3-13d542b7a45f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:49.374040 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1bc1fd31-10d9-47b7-98a3-13d542b7a45f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:49.381856 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1bc1fd31-10d9-47b7-98a3-13d542b7a45f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.159395 Jun 16 14:57:49.382435 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 36/84] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:49 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:49.385018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-08ab0867-0dd7-459d-bab4-cb2fb8931fba req-18b794b2-099f-46cb-9dab-2f53a1e588b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "822acf52-490b-49b9-b85f-db02cc41a0bf", "tag": "63cdf77a-1418-4eaf-8ecb-70cb8c2c86ac"}, {"name": "network-changed", "server_uuid": "129cdf3c-4878-4058-9cb3-a2d36be40174", "tag": "dc9a5426-4d1e-4bfb-b195-628a512c0bf9"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:57:49.395034 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-08ab0867-0dd7-459d-bab4-cb2fb8931fba req-18b794b2-099f-46cb-9dab-2f53a1e588b3 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:49.395482 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-08ab0867-0dd7-459d-bab4-cb2fb8931fba req-18b794b2-099f-46cb-9dab-2f53a1e588b3 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:49.408539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-08ab0867-0dd7-459d-bab4-cb2fb8931fba req-18b794b2-099f-46cb-9dab-2f53a1e588b3 service nova] Creating event network-changed:63cdf77a-1418-4eaf-8ecb-70cb8c2c86ac for instance 822acf52-490b-49b9-b85f-db02cc41a0bf on hv-cinder-83716 Jun 16 14:57:49.409205 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-08ab0867-0dd7-459d-bab4-cb2fb8931fba req-18b794b2-099f-46cb-9dab-2f53a1e588b3 service nova] Creating event network-changed:dc9a5426-4d1e-4bfb-b195-628a512c0bf9 for instance 129cdf3c-4878-4058-9cb3-a2d36be40174 on hv-cinder-83716 Jun 16 14:57:49.416327 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-08ab0867-0dd7-459d-bab4-cb2fb8931fba req-18b794b2-099f-46cb-9dab-2f53a1e588b3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035009 Jun 16 14:57:49.417275 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 49/85] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 14:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:57:49.470329 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9cd1761a-0740-46dc-ac8e-8004eeae1909 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:49.470984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9cd1761a-0740-46dc-ac8e-8004eeae1909 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:49.477396 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9cd1761a-0740-46dc-ac8e-8004eeae1909 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:49.477853 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9cd1761a-0740-46dc-ac8e-8004eeae1909 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:49.479217 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9cd1761a-0740-46dc-ac8e-8004eeae1909 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:49.479659 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9cd1761a-0740-46dc-ac8e-8004eeae1909 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:49.558790 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-88fadb2b-f4f7-4a09-a508-667df7c736c1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:49.559563 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-88fadb2b-f4f7-4a09-a508-667df7c736c1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:49.567790 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-88fadb2b-f4f7-4a09-a508-667df7c736c1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:49.569590 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-88fadb2b-f4f7-4a09-a508-667df7c736c1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:49.570408 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-88fadb2b-f4f7-4a09-a508-667df7c736c1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:49.570860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-88fadb2b-f4f7-4a09-a508-667df7c736c1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:49.634181 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9cd1761a-0740-46dc-ac8e-8004eeae1909 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:49.651299 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-88fadb2b-f4f7-4a09-a508-667df7c736c1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:49.658380 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9cd1761a-0740-46dc-ac8e-8004eeae1909 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:49.660062 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9cd1761a-0740-46dc-ac8e-8004eeae1909 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:49.661390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9cd1761a-0740-46dc-ac8e-8004eeae1909 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.195189 Jun 16 14:57:49.672366 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 37/86] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:49 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:57:49.673382 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-88fadb2b-f4f7-4a09-a508-667df7c736c1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1245 microversion: 2.1 time: 0.109658 Jun 16 14:57:49.674519 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 50/87] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:49 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1245 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:50.081787 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-80f33510-78ff-4e7d-a45c-fed2d5051155 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:50.082401 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-80f33510-78ff-4e7d-a45c-fed2d5051155 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:50.089589 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80f33510-78ff-4e7d-a45c-fed2d5051155 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:50.090167 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80f33510-78ff-4e7d-a45c-fed2d5051155 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:50.091025 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80f33510-78ff-4e7d-a45c-fed2d5051155 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:50.091401 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80f33510-78ff-4e7d-a45c-fed2d5051155 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:50.273998 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-80f33510-78ff-4e7d-a45c-fed2d5051155 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:50.284583 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-80f33510-78ff-4e7d-a45c-fed2d5051155 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.207213 Jun 16 14:57:50.294799 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 38/88] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:50 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:50.399095 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6e6a638d-25ea-476a-926e-692796e5b343 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:50.399715 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6e6a638d-25ea-476a-926e-692796e5b343 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:50.406404 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e6a638d-25ea-476a-926e-692796e5b343 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:50.406885 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e6a638d-25ea-476a-926e-692796e5b343 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:50.407572 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e6a638d-25ea-476a-926e-692796e5b343 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:50.408116 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e6a638d-25ea-476a-926e-692796e5b343 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:50.578465 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6e6a638d-25ea-476a-926e-692796e5b343 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:50.586137 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6e6a638d-25ea-476a-926e-692796e5b343 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.190886 Jun 16 14:57:50.586701 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 51/89] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:50 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:50.679329 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f44fb5fa-316b-4380-9ea6-0402b604a0f7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:50.679946 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f44fb5fa-316b-4380-9ea6-0402b604a0f7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:50.686768 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f44fb5fa-316b-4380-9ea6-0402b604a0f7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:50.687162 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f44fb5fa-316b-4380-9ea6-0402b604a0f7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:50.687941 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f44fb5fa-316b-4380-9ea6-0402b604a0f7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:50.688606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f44fb5fa-316b-4380-9ea6-0402b604a0f7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:50.692298 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1ed3e917-3409-4595-8257-baa5d370aa09 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:50.693174 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1ed3e917-3409-4595-8257-baa5d370aa09 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:50.700195 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1ed3e917-3409-4595-8257-baa5d370aa09 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:50.700722 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1ed3e917-3409-4595-8257-baa5d370aa09 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:50.701594 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1ed3e917-3409-4595-8257-baa5d370aa09 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:50.702099 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1ed3e917-3409-4595-8257-baa5d370aa09 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:50.767604 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1ed3e917-3409-4595-8257-baa5d370aa09 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:50.778331 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1ed3e917-3409-4595-8257-baa5d370aa09 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1245 microversion: 2.1 time: 0.089995 Jun 16 14:57:50.779103 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 52/90] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:50 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:50.841178 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f44fb5fa-316b-4380-9ea6-0402b604a0f7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:50.849835 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f44fb5fa-316b-4380-9ea6-0402b604a0f7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:50.851353 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f44fb5fa-316b-4380-9ea6-0402b604a0f7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:50.852481 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f44fb5fa-316b-4380-9ea6-0402b604a0f7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.177029 Jun 16 14:57:50.853083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 39/91] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:50 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:57:51.301964 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0c21022d-06a6-451b-91f8-88a1ccdbf7e0 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:51.302583 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0c21022d-06a6-451b-91f8-88a1ccdbf7e0 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:51.308756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c21022d-06a6-451b-91f8-88a1ccdbf7e0 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:51.309249 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c21022d-06a6-451b-91f8-88a1ccdbf7e0 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:51.310174 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c21022d-06a6-451b-91f8-88a1ccdbf7e0 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:51.310803 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c21022d-06a6-451b-91f8-88a1ccdbf7e0 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:51.452102 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0c21022d-06a6-451b-91f8-88a1ccdbf7e0 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:51.460007 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0c21022d-06a6-451b-91f8-88a1ccdbf7e0 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.161725 Jun 16 14:57:51.460458 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 53/92] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:51 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:51.603146 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3a2a2584-3032-4fed-a779-79bb4d51e3c7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:51.604268 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3a2a2584-3032-4fed-a779-79bb4d51e3c7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:51.610310 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3a2a2584-3032-4fed-a779-79bb4d51e3c7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:51.610768 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3a2a2584-3032-4fed-a779-79bb4d51e3c7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:51.611534 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3a2a2584-3032-4fed-a779-79bb4d51e3c7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:51.611971 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3a2a2584-3032-4fed-a779-79bb4d51e3c7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:51.798060 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-39949f88-ce2d-448c-9dc2-331ffedd19f9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:51.798863 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-39949f88-ce2d-448c-9dc2-331ffedd19f9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:51.807964 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3a2a2584-3032-4fed-a779-79bb4d51e3c7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:51.809754 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39949f88-ce2d-448c-9dc2-331ffedd19f9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:51.810212 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39949f88-ce2d-448c-9dc2-331ffedd19f9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:51.810993 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39949f88-ce2d-448c-9dc2-331ffedd19f9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:51.811536 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39949f88-ce2d-448c-9dc2-331ffedd19f9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:51.849298 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3a2a2584-3032-4fed-a779-79bb4d51e3c7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.241538 Jun 16 14:57:51.850846 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 40/93] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:51 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:51.873151 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8c9eeb00-4b1d-4d73-a58f-2b6e559b62e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:51.874629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8c9eeb00-4b1d-4d73-a58f-2b6e559b62e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:51.895149 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-39949f88-ce2d-448c-9dc2-331ffedd19f9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:51.895398 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c9eeb00-4b1d-4d73-a58f-2b6e559b62e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:51.896061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c9eeb00-4b1d-4d73-a58f-2b6e559b62e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:51.900619 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c9eeb00-4b1d-4d73-a58f-2b6e559b62e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:51.902407 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c9eeb00-4b1d-4d73-a58f-2b6e559b62e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:51.910504 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-39949f88-ce2d-448c-9dc2-331ffedd19f9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1245 microversion: 2.1 time: 0.117749 Jun 16 14:57:51.911082 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 54/94] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:51 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1245 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:52.057779 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8c9eeb00-4b1d-4d73-a58f-2b6e559b62e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:52.065825 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8c9eeb00-4b1d-4d73-a58f-2b6e559b62e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:52.067329 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8c9eeb00-4b1d-4d73-a58f-2b6e559b62e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:52.068447 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8c9eeb00-4b1d-4d73-a58f-2b6e559b62e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.200079 Jun 16 14:57:52.069035 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 41/95] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:51 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:57:52.481209 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-babfc8d2-6afd-4637-a8c0-7d48f1889739 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:52.481808 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-babfc8d2-6afd-4637-a8c0-7d48f1889739 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:52.487790 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-babfc8d2-6afd-4637-a8c0-7d48f1889739 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:52.488240 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-babfc8d2-6afd-4637-a8c0-7d48f1889739 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:52.489022 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-babfc8d2-6afd-4637-a8c0-7d48f1889739 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:52.489461 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-babfc8d2-6afd-4637-a8c0-7d48f1889739 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:52.633168 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-babfc8d2-6afd-4637-a8c0-7d48f1889739 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:52.640753 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-babfc8d2-6afd-4637-a8c0-7d48f1889739 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.164016 Jun 16 14:57:52.641358 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 55/96] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:52 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:52.878501 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9278e05b-6801-4e00-972f-53618f42e226 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:52.879767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9278e05b-6801-4e00-972f-53618f42e226 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:52.891896 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9278e05b-6801-4e00-972f-53618f42e226 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:52.892644 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9278e05b-6801-4e00-972f-53618f42e226 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:52.893639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9278e05b-6801-4e00-972f-53618f42e226 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:52.894238 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9278e05b-6801-4e00-972f-53618f42e226 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:52.935915 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c4de66fa-ed53-4e48-ac05-cc4518acd04d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:52.936538 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c4de66fa-ed53-4e48-ac05-cc4518acd04d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:52.944023 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c4de66fa-ed53-4e48-ac05-cc4518acd04d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:52.944652 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c4de66fa-ed53-4e48-ac05-cc4518acd04d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:52.945607 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c4de66fa-ed53-4e48-ac05-cc4518acd04d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:52.946194 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c4de66fa-ed53-4e48-ac05-cc4518acd04d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:53.011880 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c4de66fa-ed53-4e48-ac05-cc4518acd04d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:53.024564 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c4de66fa-ed53-4e48-ac05-cc4518acd04d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1245 microversion: 2.1 time: 0.092584 Jun 16 14:57:53.025392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 56/97] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:52 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:53.067460 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9278e05b-6801-4e00-972f-53618f42e226 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:53.077798 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9278e05b-6801-4e00-972f-53618f42e226 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.206773 Jun 16 14:57:53.078373 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 42/98] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:52 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:53.086546 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a7d3d0ce-d0d5-4bf5-8a1b-fd71b25ceb91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:53.087153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a7d3d0ce-d0d5-4bf5-8a1b-fd71b25ceb91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:53.094455 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7d3d0ce-d0d5-4bf5-8a1b-fd71b25ceb91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:53.094978 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7d3d0ce-d0d5-4bf5-8a1b-fd71b25ceb91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:53.095747 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7d3d0ce-d0d5-4bf5-8a1b-fd71b25ceb91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:53.096271 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7d3d0ce-d0d5-4bf5-8a1b-fd71b25ceb91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:53.248082 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a7d3d0ce-d0d5-4bf5-8a1b-fd71b25ceb91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:53.256631 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a7d3d0ce-d0d5-4bf5-8a1b-fd71b25ceb91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:53.258418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a7d3d0ce-d0d5-4bf5-8a1b-fd71b25ceb91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:53.259530 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a7d3d0ce-d0d5-4bf5-8a1b-fd71b25ceb91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.176882 Jun 16 14:57:53.260074 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 57/99] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:53 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:57:53.659196 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fabca924-4cc6-4adf-a546-6b1c22726e9a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:53.659932 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fabca924-4cc6-4adf-a546-6b1c22726e9a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:53.666617 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fabca924-4cc6-4adf-a546-6b1c22726e9a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:53.667089 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fabca924-4cc6-4adf-a546-6b1c22726e9a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:53.667865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fabca924-4cc6-4adf-a546-6b1c22726e9a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:53.668310 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fabca924-4cc6-4adf-a546-6b1c22726e9a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:53.822377 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-fabca924-4cc6-4adf-a546-6b1c22726e9a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:53.830208 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fabca924-4cc6-4adf-a546-6b1c22726e9a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.176164 Jun 16 14:57:53.831082 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 43/100] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:53 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:54.043396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f4e002e8-a3e6-4e1b-8c89-35b6105e6687 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:54.044010 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f4e002e8-a3e6-4e1b-8c89-35b6105e6687 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:54.050106 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f4e002e8-a3e6-4e1b-8c89-35b6105e6687 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:54.050564 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f4e002e8-a3e6-4e1b-8c89-35b6105e6687 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:54.051334 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f4e002e8-a3e6-4e1b-8c89-35b6105e6687 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:54.051778 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f4e002e8-a3e6-4e1b-8c89-35b6105e6687 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:54.095643 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2dc06642-3f1c-4c86-86b4-c01d57bf1a5e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:54.096259 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2dc06642-3f1c-4c86-86b4-c01d57bf1a5e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:54.102401 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2dc06642-3f1c-4c86-86b4-c01d57bf1a5e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:54.102855 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2dc06642-3f1c-4c86-86b4-c01d57bf1a5e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:54.104231 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2dc06642-3f1c-4c86-86b4-c01d57bf1a5e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:54.104679 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2dc06642-3f1c-4c86-86b4-c01d57bf1a5e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:54.120885 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f4e002e8-a3e6-4e1b-8c89-35b6105e6687 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:54.123947 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:54.128811 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f4e002e8-a3e6-4e1b-8c89-35b6105e6687 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1245 microversion: 2.1 time: 0.089731 Jun 16 14:57:54.129520 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 58/101] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:54 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:54.190423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=6 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:54.241467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2dc06642-3f1c-4c86-86b4-c01d57bf1a5e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:54.249713 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2dc06642-3f1c-4c86-86b4-c01d57bf1a5e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.158289 Jun 16 14:57:54.250282 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 44/102] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:54 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:54.278121 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f750812d-186d-400e-93dd-f39a8aae5070 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:54.278652 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f750812d-186d-400e-93dd-f39a8aae5070 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:54.284673 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f750812d-186d-400e-93dd-f39a8aae5070 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:54.285162 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f750812d-186d-400e-93dd-f39a8aae5070 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:54.285993 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f750812d-186d-400e-93dd-f39a8aae5070 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:54.286362 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f750812d-186d-400e-93dd-f39a8aae5070 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:54.422871 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f750812d-186d-400e-93dd-f39a8aae5070 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:54.426506 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:54.432875 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f750812d-186d-400e-93dd-f39a8aae5070 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:54.434393 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f750812d-186d-400e-93dd-f39a8aae5070 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:54.435512 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f750812d-186d-400e-93dd-f39a8aae5070 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.161602 Jun 16 14:57:54.436065 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 59/103] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:54 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:57:54.847051 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-554b426a-ccc7-4df4-8bc1-48e19d7e4be4 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:54.847662 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-554b426a-ccc7-4df4-8bc1-48e19d7e4be4 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:54.854596 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-554b426a-ccc7-4df4-8bc1-48e19d7e4be4 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:54.855049 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-554b426a-ccc7-4df4-8bc1-48e19d7e4be4 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:54.855816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-554b426a-ccc7-4df4-8bc1-48e19d7e4be4 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:54.856251 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-554b426a-ccc7-4df4-8bc1-48e19d7e4be4 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:54.997264 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-554b426a-ccc7-4df4-8bc1-48e19d7e4be4 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:55.004870 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-554b426a-ccc7-4df4-8bc1-48e19d7e4be4 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.161563 Jun 16 14:57:55.005423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 45/104] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:54 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:55.146356 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-55116be5-7c3a-4ffd-89af-23d75f5702fe tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:55.146959 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-55116be5-7c3a-4ffd-89af-23d75f5702fe tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:55.153223 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-55116be5-7c3a-4ffd-89af-23d75f5702fe tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:55.153844 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-55116be5-7c3a-4ffd-89af-23d75f5702fe tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:55.154601 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-55116be5-7c3a-4ffd-89af-23d75f5702fe tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:55.155027 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-55116be5-7c3a-4ffd-89af-23d75f5702fe tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:55.219032 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-55116be5-7c3a-4ffd-89af-23d75f5702fe tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:55.226356 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-55116be5-7c3a-4ffd-89af-23d75f5702fe tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1245 microversion: 2.1 time: 0.084012 Jun 16 14:57:55.226905 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 60/105] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:55 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:55.266469 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-147d8446-f9db-48d0-9d43-4de8611ae874 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:55.267083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-147d8446-f9db-48d0-9d43-4de8611ae874 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:55.273414 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-147d8446-f9db-48d0-9d43-4de8611ae874 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:55.273872 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-147d8446-f9db-48d0-9d43-4de8611ae874 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:55.274647 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-147d8446-f9db-48d0-9d43-4de8611ae874 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:55.275127 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-147d8446-f9db-48d0-9d43-4de8611ae874 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:55.404125 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-147d8446-f9db-48d0-9d43-4de8611ae874 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:55.411749 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-147d8446-f9db-48d0-9d43-4de8611ae874 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.149246 Jun 16 14:57:55.412306 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 46/106] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:55 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:55.453326 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1bceb237-9243-484a-82aa-ed2c65916753 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:55.454049 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1bceb237-9243-484a-82aa-ed2c65916753 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:55.460484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1bceb237-9243-484a-82aa-ed2c65916753 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:55.461096 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1bceb237-9243-484a-82aa-ed2c65916753 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:55.461876 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1bceb237-9243-484a-82aa-ed2c65916753 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:55.462481 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1bceb237-9243-484a-82aa-ed2c65916753 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:55.595006 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1bceb237-9243-484a-82aa-ed2c65916753 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:55.603003 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1bceb237-9243-484a-82aa-ed2c65916753 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:55.605112 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1bceb237-9243-484a-82aa-ed2c65916753 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:55.606221 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1bceb237-9243-484a-82aa-ed2c65916753 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.157048 Jun 16 14:57:55.606773 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 61/107] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:55 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:57:56.022501 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c801630e-a038-4487-8574-e0fa6d71899f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:56.023112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c801630e-a038-4487-8574-e0fa6d71899f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:56.030095 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c801630e-a038-4487-8574-e0fa6d71899f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:56.030554 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c801630e-a038-4487-8574-e0fa6d71899f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:56.031323 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c801630e-a038-4487-8574-e0fa6d71899f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:56.031765 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c801630e-a038-4487-8574-e0fa6d71899f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:56.168042 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c801630e-a038-4487-8574-e0fa6d71899f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:56.175830 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c801630e-a038-4487-8574-e0fa6d71899f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.157129 Jun 16 14:57:56.176408 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 47/108] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:56 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:56.244583 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-21faf556-32ed-4845-8f37-e6a0efbe5318 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:56.245218 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-21faf556-32ed-4845-8f37-e6a0efbe5318 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:56.251379 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-21faf556-32ed-4845-8f37-e6a0efbe5318 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:56.251828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-21faf556-32ed-4845-8f37-e6a0efbe5318 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:56.252590 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-21faf556-32ed-4845-8f37-e6a0efbe5318 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:56.253060 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-21faf556-32ed-4845-8f37-e6a0efbe5318 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:56.314780 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-21faf556-32ed-4845-8f37-e6a0efbe5318 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:56.322716 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-21faf556-32ed-4845-8f37-e6a0efbe5318 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1245 microversion: 2.1 time: 0.081789 Jun 16 14:57:56.323278 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 62/109] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:56 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:56.429244 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-995c8b06-511a-4629-9c81-e69dfeca1a23 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:56.429827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-995c8b06-511a-4629-9c81-e69dfeca1a23 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:56.432135 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=4 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:56.437569 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-995c8b06-511a-4629-9c81-e69dfeca1a23 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:56.438048 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-995c8b06-511a-4629-9c81-e69dfeca1a23 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:56.438822 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-995c8b06-511a-4629-9c81-e69dfeca1a23 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:56.439275 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-995c8b06-511a-4629-9c81-e69dfeca1a23 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:56.573373 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-995c8b06-511a-4629-9c81-e69dfeca1a23 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:56.581049 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-995c8b06-511a-4629-9c81-e69dfeca1a23 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.155588 Jun 16 14:57:56.581624 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 48/110] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:56 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:56.623842 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3ad3dfe0-711d-4d95-a3ff-5afd654085ee tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:56.624478 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3ad3dfe0-711d-4d95-a3ff-5afd654085ee tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:56.630529 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3ad3dfe0-711d-4d95-a3ff-5afd654085ee tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:56.630977 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3ad3dfe0-711d-4d95-a3ff-5afd654085ee tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:56.631725 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3ad3dfe0-711d-4d95-a3ff-5afd654085ee tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:56.632155 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3ad3dfe0-711d-4d95-a3ff-5afd654085ee tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:56.763626 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3ad3dfe0-711d-4d95-a3ff-5afd654085ee tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:56.772587 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3ad3dfe0-711d-4d95-a3ff-5afd654085ee tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:56.774147 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3ad3dfe0-711d-4d95-a3ff-5afd654085ee tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:56.775256 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3ad3dfe0-711d-4d95-a3ff-5afd654085ee tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.155324 Jun 16 14:57:56.775804 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 63/111] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:56 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:57:57.192909 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-03e63729-2b07-4f2f-a306-561b387eb971 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:57.193844 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-03e63729-2b07-4f2f-a306-561b387eb971 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:57.200411 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03e63729-2b07-4f2f-a306-561b387eb971 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:57.200903 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03e63729-2b07-4f2f-a306-561b387eb971 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:57.201684 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03e63729-2b07-4f2f-a306-561b387eb971 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:57.202127 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03e63729-2b07-4f2f-a306-561b387eb971 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:57.336041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-03e63729-2b07-4f2f-a306-561b387eb971 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:57.340017 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b20ae918-0f82-4893-ad9d-385eadfb658e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:57.340627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b20ae918-0f82-4893-ad9d-385eadfb658e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:57.342541 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:57:57.344558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-03e63729-2b07-4f2f-a306-561b387eb971 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.155993 Jun 16 14:57:57.345183 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 49/112] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:57 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:57.347966 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b20ae918-0f82-4893-ad9d-385eadfb658e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:57.348710 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b20ae918-0f82-4893-ad9d-385eadfb658e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:57.349192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b20ae918-0f82-4893-ad9d-385eadfb658e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:57.349626 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b20ae918-0f82-4893-ad9d-385eadfb658e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:57.414138 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b20ae918-0f82-4893-ad9d-385eadfb658e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:57.422272 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b20ae918-0f82-4893-ad9d-385eadfb658e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1245 microversion: 2.1 time: 0.086627 Jun 16 14:57:57.422840 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 64/113] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:57 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:57.598347 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8ac8700a-a6f2-4f6b-834d-25ed31608f71 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:57.598960 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8ac8700a-a6f2-4f6b-834d-25ed31608f71 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:57.605583 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8ac8700a-a6f2-4f6b-834d-25ed31608f71 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:57.606033 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8ac8700a-a6f2-4f6b-834d-25ed31608f71 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:57.606785 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8ac8700a-a6f2-4f6b-834d-25ed31608f71 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:57.607217 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8ac8700a-a6f2-4f6b-834d-25ed31608f71 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:57.738315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8ac8700a-a6f2-4f6b-834d-25ed31608f71 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:57.746616 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8ac8700a-a6f2-4f6b-834d-25ed31608f71 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.152169 Jun 16 14:57:57.747177 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 50/114] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:57 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:57.793761 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-bc65b870-e5b6-49dd-9f6e-717f065dd1fe tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:57.794370 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-bc65b870-e5b6-49dd-9f6e-717f065dd1fe tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:57.800519 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bc65b870-e5b6-49dd-9f6e-717f065dd1fe tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:57.801016 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bc65b870-e5b6-49dd-9f6e-717f065dd1fe tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:57.801792 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bc65b870-e5b6-49dd-9f6e-717f065dd1fe tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:57.802233 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bc65b870-e5b6-49dd-9f6e-717f065dd1fe tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:57.958617 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bc65b870-e5b6-49dd-9f6e-717f065dd1fe tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:57.969833 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bc65b870-e5b6-49dd-9f6e-717f065dd1fe tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:57.972920 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bc65b870-e5b6-49dd-9f6e-717f065dd1fe tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:57.976974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-bc65b870-e5b6-49dd-9f6e-717f065dd1fe tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.186038 Jun 16 14:57:57.977586 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 65/115] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:57 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:57:58.363644 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8c6f3bf1-fd56-4e54-b091-d4271f83bc9a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:58.367603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8c6f3bf1-fd56-4e54-b091-d4271f83bc9a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:58.375375 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c6f3bf1-fd56-4e54-b091-d4271f83bc9a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:58.375834 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c6f3bf1-fd56-4e54-b091-d4271f83bc9a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:58.376621 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c6f3bf1-fd56-4e54-b091-d4271f83bc9a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:58.377100 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c6f3bf1-fd56-4e54-b091-d4271f83bc9a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:58.439801 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-bec482ae-4d9d-42d7-a5b0-7902284125fa tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:58.440413 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-bec482ae-4d9d-42d7-a5b0-7902284125fa tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:58.446545 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bec482ae-4d9d-42d7-a5b0-7902284125fa tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:58.447503 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bec482ae-4d9d-42d7-a5b0-7902284125fa tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:58.448322 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bec482ae-4d9d-42d7-a5b0-7902284125fa tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:58.448711 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bec482ae-4d9d-42d7-a5b0-7902284125fa tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:58.511694 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bec482ae-4d9d-42d7-a5b0-7902284125fa tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:58.519585 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8c6f3bf1-fd56-4e54-b091-d4271f83bc9a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:58.520157 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-bec482ae-4d9d-42d7-a5b0-7902284125fa tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1245 microversion: 2.1 time: 0.083977 Jun 16 14:57:58.520570 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 66/116] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:58 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:58.528143 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8c6f3bf1-fd56-4e54-b091-d4271f83bc9a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.170311 Jun 16 14:57:58.528704 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 51/117] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:58 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:58.764344 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9f2b75ad-f3e6-4fb1-8116-8dda6834768f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:58.764921 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9f2b75ad-f3e6-4fb1-8116-8dda6834768f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:58.771013 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9f2b75ad-f3e6-4fb1-8116-8dda6834768f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:58.771466 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9f2b75ad-f3e6-4fb1-8116-8dda6834768f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:58.772258 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9f2b75ad-f3e6-4fb1-8116-8dda6834768f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:58.772697 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9f2b75ad-f3e6-4fb1-8116-8dda6834768f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:58.970696 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9f2b75ad-f3e6-4fb1-8116-8dda6834768f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:58.979964 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9f2b75ad-f3e6-4fb1-8116-8dda6834768f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.218521 Jun 16 14:57:58.988200 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 67/118] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:58 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:57:58.995795 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c361b3f8-5907-4490-91c2-00be713012f2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:58.996487 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c361b3f8-5907-4490-91c2-00be713012f2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:59.002815 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c361b3f8-5907-4490-91c2-00be713012f2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:59.003271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c361b3f8-5907-4490-91c2-00be713012f2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:59.004044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c361b3f8-5907-4490-91c2-00be713012f2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:59.004478 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c361b3f8-5907-4490-91c2-00be713012f2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:59.136626 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c361b3f8-5907-4490-91c2-00be713012f2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:59.144806 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c361b3f8-5907-4490-91c2-00be713012f2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:59.146354 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c361b3f8-5907-4490-91c2-00be713012f2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:59.147461 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c361b3f8-5907-4490-91c2-00be713012f2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.156116 Jun 16 14:57:59.148016 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 52/119] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:57:58 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:57:59.541094 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7307f7b2-dfab-430a-bb7b-a098ab04725e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:59.542428 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7307f7b2-dfab-430a-bb7b-a098ab04725e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:59.546032 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f9a9646f-0ed3-47ae-8d25-87c8a8c87698 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:59.546739 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f9a9646f-0ed3-47ae-8d25-87c8a8c87698 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:57:59.549803 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7307f7b2-dfab-430a-bb7b-a098ab04725e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:59.551025 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7307f7b2-dfab-430a-bb7b-a098ab04725e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:59.552157 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7307f7b2-dfab-430a-bb7b-a098ab04725e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:59.552901 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7307f7b2-dfab-430a-bb7b-a098ab04725e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:59.560047 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f9a9646f-0ed3-47ae-8d25-87c8a8c87698 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:59.560047 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f9a9646f-0ed3-47ae-8d25-87c8a8c87698 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:59.560047 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f9a9646f-0ed3-47ae-8d25-87c8a8c87698 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:57:59.564044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f9a9646f-0ed3-47ae-8d25-87c8a8c87698 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:57:59.651359 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7307f7b2-dfab-430a-bb7b-a098ab04725e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:57:59.660190 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7307f7b2-dfab-430a-bb7b-a098ab04725e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1293 microversion: 2.1 time: 0.126091 Jun 16 14:57:59.660897 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 68/120] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:59 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1293 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:57:59.996333 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-48550c4d-950e-4880-9913-d5113942e0b7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:57:59.998707 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-48550c4d-950e-4880-9913-d5113942e0b7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:00.006392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-48550c4d-950e-4880-9913-d5113942e0b7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:00.006645 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-48550c4d-950e-4880-9913-d5113942e0b7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:00.007775 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-48550c4d-950e-4880-9913-d5113942e0b7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:00.007894 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-48550c4d-950e-4880-9913-d5113942e0b7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:00.055837 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f9a9646f-0ed3-47ae-8d25-87c8a8c87698 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:00.064734 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f9a9646f-0ed3-47ae-8d25-87c8a8c87698 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.523381 Jun 16 14:58:00.066291 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 53/121] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:59 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:00.170948 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d3a8096c-c1ca-493b-8950-a95323bc06c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:00.172245 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d3a8096c-c1ca-493b-8950-a95323bc06c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:00.180667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d3a8096c-c1ca-493b-8950-a95323bc06c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:00.181178 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d3a8096c-c1ca-493b-8950-a95323bc06c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:00.181971 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d3a8096c-c1ca-493b-8950-a95323bc06c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:00.182417 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d3a8096c-c1ca-493b-8950-a95323bc06c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:00.251663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-48550c4d-950e-4880-9913-d5113942e0b7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:00.264184 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-48550c4d-950e-4880-9913-d5113942e0b7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.272285 Jun 16 14:58:00.265109 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 69/122] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:57:59 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:00.341899 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d3a8096c-c1ca-493b-8950-a95323bc06c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:00.351120 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d3a8096c-c1ca-493b-8950-a95323bc06c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:00.352757 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d3a8096c-c1ca-493b-8950-a95323bc06c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:00.354502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d3a8096c-c1ca-493b-8950-a95323bc06c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.192952 Jun 16 14:58:00.355374 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 54/123] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:00 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:58:00.677988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-eba2d879-21cb-4d7c-b928-2a7da3072e92 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:00.678601 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-eba2d879-21cb-4d7c-b928-2a7da3072e92 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:00.684893 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eba2d879-21cb-4d7c-b928-2a7da3072e92 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:00.685352 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eba2d879-21cb-4d7c-b928-2a7da3072e92 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:00.686121 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eba2d879-21cb-4d7c-b928-2a7da3072e92 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:00.686556 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eba2d879-21cb-4d7c-b928-2a7da3072e92 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:00.747417 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-eba2d879-21cb-4d7c-b928-2a7da3072e92 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:00.754905 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-eba2d879-21cb-4d7c-b928-2a7da3072e92 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1301 microversion: 2.1 time: 0.080782 Jun 16 14:58:00.755463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 70/124] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:00 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1301 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:01.081847 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-42ecb7c0-40f0-42f8-acdb-30253da24306 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:01.082461 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-42ecb7c0-40f0-42f8-acdb-30253da24306 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:01.089133 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-42ecb7c0-40f0-42f8-acdb-30253da24306 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:01.089591 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-42ecb7c0-40f0-42f8-acdb-30253da24306 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:01.090361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-42ecb7c0-40f0-42f8-acdb-30253da24306 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:01.090806 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-42ecb7c0-40f0-42f8-acdb-30253da24306 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:01.232009 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-42ecb7c0-40f0-42f8-acdb-30253da24306 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:01.239468 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-42ecb7c0-40f0-42f8-acdb-30253da24306 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.161460 Jun 16 14:58:01.240028 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 55/125] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:01 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:01.281571 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-dbe64d5e-3d6a-4789-ba71-618f80525097 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:01.282179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-dbe64d5e-3d6a-4789-ba71-618f80525097 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:01.288260 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dbe64d5e-3d6a-4789-ba71-618f80525097 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:01.288715 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dbe64d5e-3d6a-4789-ba71-618f80525097 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:01.289507 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dbe64d5e-3d6a-4789-ba71-618f80525097 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:01.289948 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dbe64d5e-3d6a-4789-ba71-618f80525097 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:01.372445 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-195ee5f2-1c91-4ced-be45-1871f0857091 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:01.373002 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-195ee5f2-1c91-4ced-be45-1871f0857091 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:01.387671 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-195ee5f2-1c91-4ced-be45-1871f0857091 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:01.388144 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-195ee5f2-1c91-4ced-be45-1871f0857091 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:01.388940 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-195ee5f2-1c91-4ced-be45-1871f0857091 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:01.389478 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-195ee5f2-1c91-4ced-be45-1871f0857091 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:01.449723 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-dbe64d5e-3d6a-4789-ba71-618f80525097 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:01.457880 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-dbe64d5e-3d6a-4789-ba71-618f80525097 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.180103 Jun 16 14:58:01.460931 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 71/126] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:01 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:01.537975 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-195ee5f2-1c91-4ced-be45-1871f0857091 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:01.546624 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-195ee5f2-1c91-4ced-be45-1871f0857091 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:01.548080 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-195ee5f2-1c91-4ced-be45-1871f0857091 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:01.549233 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-195ee5f2-1c91-4ced-be45-1871f0857091 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.181490 Jun 16 14:58:01.549793 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 56/127] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:01 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:58:01.773536 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f6f1919c-4f05-4cb2-82bc-857238f9fff3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:01.774112 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f6f1919c-4f05-4cb2-82bc-857238f9fff3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:01.781410 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f6f1919c-4f05-4cb2-82bc-857238f9fff3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:01.781852 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f6f1919c-4f05-4cb2-82bc-857238f9fff3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:01.782606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f6f1919c-4f05-4cb2-82bc-857238f9fff3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:01.783104 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f6f1919c-4f05-4cb2-82bc-857238f9fff3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:01.844362 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f6f1919c-4f05-4cb2-82bc-857238f9fff3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:01.851880 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f6f1919c-4f05-4cb2-82bc-857238f9fff3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1301 microversion: 2.1 time: 0.082671 Jun 16 14:58:01.852444 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 72/128] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:01 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1301 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:02.257443 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4d270ea5-193a-4684-889d-2b96230ccb70 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:02.258788 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4d270ea5-193a-4684-889d-2b96230ccb70 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:02.266476 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d270ea5-193a-4684-889d-2b96230ccb70 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:02.266953 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d270ea5-193a-4684-889d-2b96230ccb70 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:02.267710 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d270ea5-193a-4684-889d-2b96230ccb70 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:02.268151 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d270ea5-193a-4684-889d-2b96230ccb70 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:02.402536 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4d270ea5-193a-4684-889d-2b96230ccb70 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:02.410220 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4d270ea5-193a-4684-889d-2b96230ccb70 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.156715 Jun 16 14:58:02.410788 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 57/129] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:02 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:02.476220 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-06337fef-dfec-4602-a0cb-e57eb5890e44 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:02.477201 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-06337fef-dfec-4602-a0cb-e57eb5890e44 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:02.484116 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-06337fef-dfec-4602-a0cb-e57eb5890e44 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:02.484559 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-06337fef-dfec-4602-a0cb-e57eb5890e44 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:02.485546 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-06337fef-dfec-4602-a0cb-e57eb5890e44 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:02.486016 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-06337fef-dfec-4602-a0cb-e57eb5890e44 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:02.567994 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d9aebaf6-7bc3-4f46-a02a-807493d60464 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:02.568608 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d9aebaf6-7bc3-4f46-a02a-807493d60464 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:02.575916 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d9aebaf6-7bc3-4f46-a02a-807493d60464 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:02.576371 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d9aebaf6-7bc3-4f46-a02a-807493d60464 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:02.577174 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d9aebaf6-7bc3-4f46-a02a-807493d60464 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:02.577616 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d9aebaf6-7bc3-4f46-a02a-807493d60464 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:02.621857 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-06337fef-dfec-4602-a0cb-e57eb5890e44 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:02.629376 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-06337fef-dfec-4602-a0cb-e57eb5890e44 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.158072 Jun 16 14:58:02.629949 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 73/130] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:02 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:02.723890 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d9aebaf6-7bc3-4f46-a02a-807493d60464 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:02.732533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d9aebaf6-7bc3-4f46-a02a-807493d60464 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:02.734251 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d9aebaf6-7bc3-4f46-a02a-807493d60464 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:02.735397 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d9aebaf6-7bc3-4f46-a02a-807493d60464 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.171361 Jun 16 14:58:02.735971 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 58/131] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:02 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:58:02.871656 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-75006ba9-e57d-41da-9ebd-14245f958852 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:02.872247 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-75006ba9-e57d-41da-9ebd-14245f958852 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:02.878605 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75006ba9-e57d-41da-9ebd-14245f958852 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:02.879052 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75006ba9-e57d-41da-9ebd-14245f958852 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:02.879809 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75006ba9-e57d-41da-9ebd-14245f958852 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:02.880304 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75006ba9-e57d-41da-9ebd-14245f958852 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:02.945321 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-75006ba9-e57d-41da-9ebd-14245f958852 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:02.953001 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-75006ba9-e57d-41da-9ebd-14245f958852 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1301 microversion: 2.1 time: 0.087009 Jun 16 14:58:02.953569 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 74/132] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:02 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1301 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:03.427575 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fcea0a27-6039-4975-8a6a-335091558a45 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:03.428212 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fcea0a27-6039-4975-8a6a-335091558a45 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:03.434859 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fcea0a27-6039-4975-8a6a-335091558a45 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:03.435349 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fcea0a27-6039-4975-8a6a-335091558a45 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:03.436121 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fcea0a27-6039-4975-8a6a-335091558a45 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:03.436576 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fcea0a27-6039-4975-8a6a-335091558a45 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:03.569591 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-fcea0a27-6039-4975-8a6a-335091558a45 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:03.578324 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fcea0a27-6039-4975-8a6a-335091558a45 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.154593 Jun 16 14:58:03.578901 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 59/133] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:03 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:03.646826 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-05128272-2070-4c6d-80ea-5563d14c0d76 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:03.647432 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-05128272-2070-4c6d-80ea-5563d14c0d76 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:03.654443 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-05128272-2070-4c6d-80ea-5563d14c0d76 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:03.654892 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-05128272-2070-4c6d-80ea-5563d14c0d76 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:03.655658 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-05128272-2070-4c6d-80ea-5563d14c0d76 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:03.656127 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-05128272-2070-4c6d-80ea-5563d14c0d76 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:03.753978 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d7fb0e4c-154c-4ba4-8212-a056f1109198 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:03.755027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d7fb0e4c-154c-4ba4-8212-a056f1109198 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:03.762580 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7fb0e4c-154c-4ba4-8212-a056f1109198 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:03.763025 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7fb0e4c-154c-4ba4-8212-a056f1109198 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:03.763792 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7fb0e4c-154c-4ba4-8212-a056f1109198 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:03.764226 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7fb0e4c-154c-4ba4-8212-a056f1109198 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:03.798445 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-05128272-2070-4c6d-80ea-5563d14c0d76 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:03.806055 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-05128272-2070-4c6d-80ea-5563d14c0d76 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.163033 Jun 16 14:58:03.806629 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 75/134] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:03 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:03.903569 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d7fb0e4c-154c-4ba4-8212-a056f1109198 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:03.911501 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d7fb0e4c-154c-4ba4-8212-a056f1109198 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:03.913005 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d7fb0e4c-154c-4ba4-8212-a056f1109198 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:03.914098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d7fb0e4c-154c-4ba4-8212-a056f1109198 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.164193 Jun 16 14:58:03.914645 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 60/135] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:03 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:58:03.970152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7ed4339e-debd-4af6-b6d3-6a3d8b964465 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:03.970751 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7ed4339e-debd-4af6-b6d3-6a3d8b964465 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:03.977069 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ed4339e-debd-4af6-b6d3-6a3d8b964465 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:03.977525 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ed4339e-debd-4af6-b6d3-6a3d8b964465 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:03.978327 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ed4339e-debd-4af6-b6d3-6a3d8b964465 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:03.978766 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ed4339e-debd-4af6-b6d3-6a3d8b964465 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:03.997435 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:04.041364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7ed4339e-debd-4af6-b6d3-6a3d8b964465 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:04.049014 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7ed4339e-debd-4af6-b6d3-6a3d8b964465 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1301 microversion: 2.1 time: 0.082591 Jun 16 14:58:04.049578 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 76/136] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:03 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1301 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:04.596086 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c115c126-c5f5-4ab5-bd08-e4dcca28b562 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:04.596690 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c115c126-c5f5-4ab5-bd08-e4dcca28b562 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:04.602840 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c115c126-c5f5-4ab5-bd08-e4dcca28b562 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:04.603878 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c115c126-c5f5-4ab5-bd08-e4dcca28b562 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:04.604676 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c115c126-c5f5-4ab5-bd08-e4dcca28b562 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:04.605139 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c115c126-c5f5-4ab5-bd08-e4dcca28b562 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:04.609115 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:04.740079 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c115c126-c5f5-4ab5-bd08-e4dcca28b562 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:04.751020 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c115c126-c5f5-4ab5-bd08-e4dcca28b562 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.158662 Jun 16 14:58:04.751928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 61/137] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:04 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:04.823129 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e232a11c-c931-415e-8264-7526e09e8e56 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:04.823655 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e232a11c-c931-415e-8264-7526e09e8e56 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:04.829836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e232a11c-c931-415e-8264-7526e09e8e56 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:04.830291 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e232a11c-c931-415e-8264-7526e09e8e56 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:04.831057 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e232a11c-c931-415e-8264-7526e09e8e56 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:04.831494 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e232a11c-c931-415e-8264-7526e09e8e56 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:04.931569 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4b46830f-b38c-4c0c-a874-139480552c22 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:04.932218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4b46830f-b38c-4c0c-a874-139480552c22 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:04.939306 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4b46830f-b38c-4c0c-a874-139480552c22 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:04.939819 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4b46830f-b38c-4c0c-a874-139480552c22 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:04.940528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4b46830f-b38c-4c0c-a874-139480552c22 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:04.940990 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4b46830f-b38c-4c0c-a874-139480552c22 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:04.978658 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e232a11c-c931-415e-8264-7526e09e8e56 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:04.986933 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e232a11c-c931-415e-8264-7526e09e8e56 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.167629 Jun 16 14:58:04.987565 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 77/138] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:04 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:05.067431 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b9c204ac-e629-4221-ab8e-45d49aff31dc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:05.068044 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b9c204ac-e629-4221-ab8e-45d49aff31dc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:05.074879 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b9c204ac-e629-4221-ab8e-45d49aff31dc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:05.075263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b9c204ac-e629-4221-ab8e-45d49aff31dc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:05.076039 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b9c204ac-e629-4221-ab8e-45d49aff31dc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:05.076476 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b9c204ac-e629-4221-ab8e-45d49aff31dc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:05.088970 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4b46830f-b38c-4c0c-a874-139480552c22 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:05.097998 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4b46830f-b38c-4c0c-a874-139480552c22 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:05.099500 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4b46830f-b38c-4c0c-a874-139480552c22 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:05.100633 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4b46830f-b38c-4c0c-a874-139480552c22 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.173096 Jun 16 14:58:05.101335 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 62/139] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:04 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:58:05.138981 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b9c204ac-e629-4221-ab8e-45d49aff31dc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:05.146398 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b9c204ac-e629-4221-ab8e-45d49aff31dc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1301 microversion: 2.1 time: 0.083206 Jun 16 14:58:05.146960 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 78/140] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:05 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1301 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:05.768540 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-25b73920-904a-4ffc-b4cb-c3d3248c245b tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:05.769765 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-25b73920-904a-4ffc-b4cb-c3d3248c245b tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:05.776547 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-25b73920-904a-4ffc-b4cb-c3d3248c245b tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:05.777246 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-25b73920-904a-4ffc-b4cb-c3d3248c245b tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:05.778233 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-25b73920-904a-4ffc-b4cb-c3d3248c245b tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:05.778682 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-25b73920-904a-4ffc-b4cb-c3d3248c245b tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:05.940473 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-25b73920-904a-4ffc-b4cb-c3d3248c245b tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:05.952599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-25b73920-904a-4ffc-b4cb-c3d3248c245b tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.188041 Jun 16 14:58:05.953678 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 63/141] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:05 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:06.005210 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-866938fe-64dc-43f5-a872-237973d21610 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:06.006029 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-866938fe-64dc-43f5-a872-237973d21610 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:06.012394 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-866938fe-64dc-43f5-a872-237973d21610 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:06.012775 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-866938fe-64dc-43f5-a872-237973d21610 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:06.013613 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-866938fe-64dc-43f5-a872-237973d21610 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:06.014051 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-866938fe-64dc-43f5-a872-237973d21610 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:06.130415 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-61a5bbac-2a89-4ef7-9d51-1145a9a4f7e8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:06.131040 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-61a5bbac-2a89-4ef7-9d51-1145a9a4f7e8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:06.137990 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-61a5bbac-2a89-4ef7-9d51-1145a9a4f7e8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:06.138899 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-61a5bbac-2a89-4ef7-9d51-1145a9a4f7e8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:06.139686 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-61a5bbac-2a89-4ef7-9d51-1145a9a4f7e8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:06.140304 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-61a5bbac-2a89-4ef7-9d51-1145a9a4f7e8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:06.167029 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-866938fe-64dc-43f5-a872-237973d21610 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:06.174183 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-866938fe-64dc-43f5-a872-237973d21610 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.173414 Jun 16 14:58:06.175111 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 79/142] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:05 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:06.180761 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a1920745-e4f2-4e65-b0a4-d9ff0611542c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:06.182218 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a1920745-e4f2-4e65-b0a4-d9ff0611542c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:06.188827 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a1920745-e4f2-4e65-b0a4-d9ff0611542c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:06.189340 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a1920745-e4f2-4e65-b0a4-d9ff0611542c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:06.190132 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a1920745-e4f2-4e65-b0a4-d9ff0611542c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:06.190607 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a1920745-e4f2-4e65-b0a4-d9ff0611542c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:06.263428 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a1920745-e4f2-4e65-b0a4-d9ff0611542c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:06.271244 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a1920745-e4f2-4e65-b0a4-d9ff0611542c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1301 microversion: 2.1 time: 0.094612 Jun 16 14:58:06.271823 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 80/143] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:06 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1301 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:06.290866 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-61a5bbac-2a89-4ef7-9d51-1145a9a4f7e8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:06.299128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-61a5bbac-2a89-4ef7-9d51-1145a9a4f7e8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:06.300728 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-61a5bbac-2a89-4ef7-9d51-1145a9a4f7e8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:06.301984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-61a5bbac-2a89-4ef7-9d51-1145a9a4f7e8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.187030 Jun 16 14:58:06.302715 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 64/144] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:06 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:58:06.980547 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f97509dd-805b-4806-8c4b-58f055192427 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:06.981304 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f97509dd-805b-4806-8c4b-58f055192427 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:06.995926 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f97509dd-805b-4806-8c4b-58f055192427 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:06.996381 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f97509dd-805b-4806-8c4b-58f055192427 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:06.997194 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f97509dd-805b-4806-8c4b-58f055192427 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:06.997630 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f97509dd-805b-4806-8c4b-58f055192427 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:07.148342 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f97509dd-805b-4806-8c4b-58f055192427 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:07.165776 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f97509dd-805b-4806-8c4b-58f055192427 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.191404 Jun 16 14:58:07.166455 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 81/145] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:06 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:07.199492 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2a61af3e-52d2-44eb-a3af-3a0dca059659 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:07.202342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2a61af3e-52d2-44eb-a3af-3a0dca059659 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:07.211334 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a61af3e-52d2-44eb-a3af-3a0dca059659 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:07.213454 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a61af3e-52d2-44eb-a3af-3a0dca059659 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:07.215059 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a61af3e-52d2-44eb-a3af-3a0dca059659 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:07.215628 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a61af3e-52d2-44eb-a3af-3a0dca059659 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:07.291925 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b862dd7c-4fb1-43f2-9c70-4bd969c91c47 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:07.293023 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b862dd7c-4fb1-43f2-9c70-4bd969c91c47 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:07.303156 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b862dd7c-4fb1-43f2-9c70-4bd969c91c47 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:07.303793 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b862dd7c-4fb1-43f2-9c70-4bd969c91c47 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:07.304823 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b862dd7c-4fb1-43f2-9c70-4bd969c91c47 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:07.305440 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b862dd7c-4fb1-43f2-9c70-4bd969c91c47 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:07.402048 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b862dd7c-4fb1-43f2-9c70-4bd969c91c47 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:07.410245 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b862dd7c-4fb1-43f2-9c70-4bd969c91c47 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1301 microversion: 2.1 time: 0.124678 Jun 16 14:58:07.410855 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 82/146] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:07 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1301 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:07.416294 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-196dd538-3cfe-4bbd-934b-1f047bc39b0c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:07.417227 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-196dd538-3cfe-4bbd-934b-1f047bc39b0c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:07.423543 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-196dd538-3cfe-4bbd-934b-1f047bc39b0c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:07.424067 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-196dd538-3cfe-4bbd-934b-1f047bc39b0c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:07.425315 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-196dd538-3cfe-4bbd-934b-1f047bc39b0c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:07.425824 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-196dd538-3cfe-4bbd-934b-1f047bc39b0c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:07.500054 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2a61af3e-52d2-44eb-a3af-3a0dca059659 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:07.508680 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2a61af3e-52d2-44eb-a3af-3a0dca059659 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.319416 Jun 16 14:58:07.518094 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 65/147] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:07 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:07.816107 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-196dd538-3cfe-4bbd-934b-1f047bc39b0c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:07.828572 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-196dd538-3cfe-4bbd-934b-1f047bc39b0c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:07.830696 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-196dd538-3cfe-4bbd-934b-1f047bc39b0c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:07.832758 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-196dd538-3cfe-4bbd-934b-1f047bc39b0c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.420477 Jun 16 14:58:07.833591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 83/148] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:07 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:08.184726 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7168a9da-776d-4289-81f6-b7eed40c2d67 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:08.185772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7168a9da-776d-4289-81f6-b7eed40c2d67 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:08.192540 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7168a9da-776d-4289-81f6-b7eed40c2d67 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:08.193370 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7168a9da-776d-4289-81f6-b7eed40c2d67 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:08.194745 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7168a9da-776d-4289-81f6-b7eed40c2d67 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:08.195407 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7168a9da-776d-4289-81f6-b7eed40c2d67 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:08.424580 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7168a9da-776d-4289-81f6-b7eed40c2d67 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:08.429898 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-13b93a31-5ec2-48c8-8efc-170ceb497d2e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:08.430516 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-13b93a31-5ec2-48c8-8efc-170ceb497d2e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:08.438085 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-13b93a31-5ec2-48c8-8efc-170ceb497d2e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:08.438904 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-13b93a31-5ec2-48c8-8efc-170ceb497d2e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:08.440195 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-13b93a31-5ec2-48c8-8efc-170ceb497d2e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:08.441087 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-13b93a31-5ec2-48c8-8efc-170ceb497d2e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:08.456640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7168a9da-776d-4289-81f6-b7eed40c2d67 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.265322 Jun 16 14:58:08.456640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 66/149] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:08 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:08.533478 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-13b93a31-5ec2-48c8-8efc-170ceb497d2e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:08.537484 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6d4d174b-75f8-422c-b116-ff0233a67c82 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:08.538944 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6d4d174b-75f8-422c-b116-ff0233a67c82 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:08.545921 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-13b93a31-5ec2-48c8-8efc-170ceb497d2e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1301 microversion: 2.1 time: 0.122087 Jun 16 14:58:08.547721 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 84/150] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:08 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1301 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:08.548436 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6d4d174b-75f8-422c-b116-ff0233a67c82 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:08.549434 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6d4d174b-75f8-422c-b116-ff0233a67c82 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:08.550437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6d4d174b-75f8-422c-b116-ff0233a67c82 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:08.551109 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6d4d174b-75f8-422c-b116-ff0233a67c82 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:08.851568 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d4671405-5eb1-4e04-8d54-1bf822065399 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:08.853701 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d4671405-5eb1-4e04-8d54-1bf822065399 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:08.867562 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d4671405-5eb1-4e04-8d54-1bf822065399 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:08.868014 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d4671405-5eb1-4e04-8d54-1bf822065399 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:08.879939 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d4671405-5eb1-4e04-8d54-1bf822065399 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:08.879939 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d4671405-5eb1-4e04-8d54-1bf822065399 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:09.224152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d4671405-5eb1-4e04-8d54-1bf822065399 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:09.241640 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d4671405-5eb1-4e04-8d54-1bf822065399 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:09.244024 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d4671405-5eb1-4e04-8d54-1bf822065399 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:09.245137 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d4671405-5eb1-4e04-8d54-1bf822065399 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.397883 Jun 16 14:58:09.246525 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 85/151] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:08 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:58:09.266974 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6d4d174b-75f8-422c-b116-ff0233a67c82 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:09.277709 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6d4d174b-75f8-422c-b116-ff0233a67c82 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.744891 Jun 16 14:58:09.279234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 67/152] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:08 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:09.466406 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-57dd9ed3-217f-402e-942d-63bc62ff47c6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:09.467198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-57dd9ed3-217f-402e-942d-63bc62ff47c6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:09.482616 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-57dd9ed3-217f-402e-942d-63bc62ff47c6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:09.486840 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-57dd9ed3-217f-402e-942d-63bc62ff47c6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:09.487989 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-57dd9ed3-217f-402e-942d-63bc62ff47c6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:09.489945 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-57dd9ed3-217f-402e-942d-63bc62ff47c6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:09.566598 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3e588625-c9a0-4cf1-a799-8876d207ac2f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:09.568285 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3e588625-c9a0-4cf1-a799-8876d207ac2f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:09.579247 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e588625-c9a0-4cf1-a799-8876d207ac2f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:09.580234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e588625-c9a0-4cf1-a799-8876d207ac2f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:09.581509 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e588625-c9a0-4cf1-a799-8876d207ac2f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:09.582065 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e588625-c9a0-4cf1-a799-8876d207ac2f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:09.706323 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3e588625-c9a0-4cf1-a799-8876d207ac2f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:09.715838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3e588625-c9a0-4cf1-a799-8876d207ac2f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1299 microversion: 2.1 time: 0.154316 Jun 16 14:58:09.736979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 68/153] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:09 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1299 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:09.911192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-57dd9ed3-217f-402e-942d-63bc62ff47c6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:09.921339 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-57dd9ed3-217f-402e-942d-63bc62ff47c6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.459545 Jun 16 14:58:09.935501 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 86/154] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:09 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:10.287066 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ea9e52ef-68a7-4f95-b8ad-7a057575c9a1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:10.291414 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ea9e52ef-68a7-4f95-b8ad-7a057575c9a1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:10.298879 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6f9c6fb1-22cc-4835-b2f2-2ce3c80ccd1c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:10.299788 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6f9c6fb1-22cc-4835-b2f2-2ce3c80ccd1c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:10.310895 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ea9e52ef-68a7-4f95-b8ad-7a057575c9a1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:10.312711 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f9c6fb1-22cc-4835-b2f2-2ce3c80ccd1c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:10.313198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ea9e52ef-68a7-4f95-b8ad-7a057575c9a1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:10.313314 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f9c6fb1-22cc-4835-b2f2-2ce3c80ccd1c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:10.314020 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f9c6fb1-22cc-4835-b2f2-2ce3c80ccd1c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:10.314413 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f9c6fb1-22cc-4835-b2f2-2ce3c80ccd1c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:10.321460 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ea9e52ef-68a7-4f95-b8ad-7a057575c9a1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:10.322307 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ea9e52ef-68a7-4f95-b8ad-7a057575c9a1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:10.917900 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6f9c6fb1-22cc-4835-b2f2-2ce3c80ccd1c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:10.935478 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6f9c6fb1-22cc-4835-b2f2-2ce3c80ccd1c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.640810 Jun 16 14:58:10.935799 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 87/155] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:10 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:10.952895 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3dbfde07-a225-4a2a-bc15-480c6688a5b5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:10.953965 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3dbfde07-a225-4a2a-bc15-480c6688a5b5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:10.963713 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3dbfde07-a225-4a2a-bc15-480c6688a5b5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:10.964413 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3dbfde07-a225-4a2a-bc15-480c6688a5b5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:10.965378 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3dbfde07-a225-4a2a-bc15-480c6688a5b5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:10.966056 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3dbfde07-a225-4a2a-bc15-480c6688a5b5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:11.071513 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3dbfde07-a225-4a2a-bc15-480c6688a5b5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:11.100063 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3dbfde07-a225-4a2a-bc15-480c6688a5b5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1299 microversion: 2.1 time: 0.153512 Jun 16 14:58:11.104811 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 88/156] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:10 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1299 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:11.120067 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-83a0c13b-8934-4278-9b0b-a78813551ff7 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:11.121513 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-83a0c13b-8934-4278-9b0b-a78813551ff7 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:11.154788 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ea9e52ef-68a7-4f95-b8ad-7a057575c9a1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:11.162508 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-83a0c13b-8934-4278-9b0b-a78813551ff7 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:11.163248 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-83a0c13b-8934-4278-9b0b-a78813551ff7 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:11.164566 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-83a0c13b-8934-4278-9b0b-a78813551ff7 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:11.168210 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ea9e52ef-68a7-4f95-b8ad-7a057575c9a1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:11.171616 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-83a0c13b-8934-4278-9b0b-a78813551ff7 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:11.176290 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ea9e52ef-68a7-4f95-b8ad-7a057575c9a1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:11.178020 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ea9e52ef-68a7-4f95-b8ad-7a057575c9a1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.913510 Jun 16 14:58:11.179819 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 69/157] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:10 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:11.408488 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-83a0c13b-8934-4278-9b0b-a78813551ff7 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:11.425473 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-83a0c13b-8934-4278-9b0b-a78813551ff7 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.316969 Jun 16 14:58:11.426188 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 89/158] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:11 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:11.462332 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-320caaef-f488-483d-b8bc-1b063eba1976 req-41f84fa6-0b60-438f-81eb-5ae3e4ab4b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9", "name": "network-vif-plugged", "status": "completed", "tag": "4a15d94a-43cc-45b4-89d5-3b8cdc6c8c65"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:11.484555 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-320caaef-f488-483d-b8bc-1b063eba1976 req-41f84fa6-0b60-438f-81eb-5ae3e4ab4b80 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:11.486948 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-320caaef-f488-483d-b8bc-1b063eba1976 req-41f84fa6-0b60-438f-81eb-5ae3e4ab4b80 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:11.507920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-320caaef-f488-483d-b8bc-1b063eba1976 req-41f84fa6-0b60-438f-81eb-5ae3e4ab4b80 service nova] Creating event network-vif-plugged:4a15d94a-43cc-45b4-89d5-3b8cdc6c8c65 for instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 on hv-cinder-83716 Jun 16 14:58:11.516262 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-320caaef-f488-483d-b8bc-1b063eba1976 req-41f84fa6-0b60-438f-81eb-5ae3e4ab4b80 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.333667 Jun 16 14:58:11.523968 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 70/159] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 14:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:58:11.953328 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6166a2a4-b551-4da6-8aed-86bacec2fd47 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:11.954915 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6166a2a4-b551-4da6-8aed-86bacec2fd47 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:11.966629 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6166a2a4-b551-4da6-8aed-86bacec2fd47 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:11.967301 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6166a2a4-b551-4da6-8aed-86bacec2fd47 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:11.968452 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6166a2a4-b551-4da6-8aed-86bacec2fd47 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:11.970396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6166a2a4-b551-4da6-8aed-86bacec2fd47 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:12.133053 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5ba7edbf-caf8-42b7-817d-4e093f708e45 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:12.134424 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5ba7edbf-caf8-42b7-817d-4e093f708e45 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:12.148594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5ba7edbf-caf8-42b7-817d-4e093f708e45 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:12.149104 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5ba7edbf-caf8-42b7-817d-4e093f708e45 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:12.153430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5ba7edbf-caf8-42b7-817d-4e093f708e45 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:12.153951 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5ba7edbf-caf8-42b7-817d-4e093f708e45 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:12.162961 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6166a2a4-b551-4da6-8aed-86bacec2fd47 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:12.174288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6166a2a4-b551-4da6-8aed-86bacec2fd47 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.226179 Jun 16 14:58:12.175429 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 90/160] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:11 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:12.202483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f736ad73-da7d-45b4-b622-b2880997eafa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:12.203831 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f736ad73-da7d-45b4-b622-b2880997eafa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:12.214042 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f736ad73-da7d-45b4-b622-b2880997eafa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:12.214835 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f736ad73-da7d-45b4-b622-b2880997eafa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:12.215941 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f736ad73-da7d-45b4-b622-b2880997eafa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:12.216535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f736ad73-da7d-45b4-b622-b2880997eafa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:12.420622 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5ba7edbf-caf8-42b7-817d-4e093f708e45 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:12.434389 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5ba7edbf-caf8-42b7-817d-4e093f708e45 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.309116 Jun 16 14:58:12.434389 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 71/161] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:12 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:12.452393 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-17d83f0e-1919-4932-8319-2e1cf6d0a5ad tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:12.453710 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-17d83f0e-1919-4932-8319-2e1cf6d0a5ad tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:12.466469 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-17d83f0e-1919-4932-8319-2e1cf6d0a5ad tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:12.468133 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-17d83f0e-1919-4932-8319-2e1cf6d0a5ad tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:12.470194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-17d83f0e-1919-4932-8319-2e1cf6d0a5ad tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:12.471188 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-17d83f0e-1919-4932-8319-2e1cf6d0a5ad tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:12.491505 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f736ad73-da7d-45b4-b622-b2880997eafa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:12.505982 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f736ad73-da7d-45b4-b622-b2880997eafa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:12.506794 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f736ad73-da7d-45b4-b622-b2880997eafa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:12.507954 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f736ad73-da7d-45b4-b622-b2880997eafa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.313753 Jun 16 14:58:12.508509 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 91/162] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:12 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:12.661659 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-17d83f0e-1919-4932-8319-2e1cf6d0a5ad tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:12.672524 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-17d83f0e-1919-4932-8319-2e1cf6d0a5ad tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.227616 Jun 16 14:58:12.675013 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 72/163] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:12 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:13.198104 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c39b0f28-17d6-4bd1-9376-32dc6715e46a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:13.201026 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c39b0f28-17d6-4bd1-9376-32dc6715e46a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:13.210916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c39b0f28-17d6-4bd1-9376-32dc6715e46a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:13.211379 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c39b0f28-17d6-4bd1-9376-32dc6715e46a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:13.212956 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c39b0f28-17d6-4bd1-9376-32dc6715e46a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:13.213403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c39b0f28-17d6-4bd1-9376-32dc6715e46a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:13.376928 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c39b0f28-17d6-4bd1-9376-32dc6715e46a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:13.391420 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c39b0f28-17d6-4bd1-9376-32dc6715e46a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.202801 Jun 16 14:58:13.393615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 92/164] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:13 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:13.449880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b2b01040-b305-4ec1-9575-31735d0b08b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:13.450730 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b2b01040-b305-4ec1-9575-31735d0b08b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:13.468537 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b2b01040-b305-4ec1-9575-31735d0b08b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:13.478575 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b2b01040-b305-4ec1-9575-31735d0b08b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:13.479979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b2b01040-b305-4ec1-9575-31735d0b08b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:13.481824 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b2b01040-b305-4ec1-9575-31735d0b08b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:13.535384 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-31bece9e-e05e-4ad0-b38b-52ff2de93c6a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:13.536251 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-31bece9e-e05e-4ad0-b38b-52ff2de93c6a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:13.547270 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:13.551495 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-31bece9e-e05e-4ad0-b38b-52ff2de93c6a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:13.553063 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-31bece9e-e05e-4ad0-b38b-52ff2de93c6a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:13.554117 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-31bece9e-e05e-4ad0-b38b-52ff2de93c6a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:13.554808 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-31bece9e-e05e-4ad0-b38b-52ff2de93c6a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:13.562216 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:13.839516 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-31bece9e-e05e-4ad0-b38b-52ff2de93c6a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:13.843142 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b2b01040-b305-4ec1-9575-31735d0b08b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:13.849388 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-31bece9e-e05e-4ad0-b38b-52ff2de93c6a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:13.850834 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-31bece9e-e05e-4ad0-b38b-52ff2de93c6a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:13.851992 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-31bece9e-e05e-4ad0-b38b-52ff2de93c6a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.325330 Jun 16 14:58:13.856572 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 93/165] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:13 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:13.861548 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ef50a1fa-1482-45ab-83c3-dd00eec3cdcc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:13.862164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ef50a1fa-1482-45ab-83c3-dd00eec3cdcc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:13.866003 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b2b01040-b305-4ec1-9575-31735d0b08b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.410482 Jun 16 14:58:13.869115 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 73/166] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:13 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:13.870882 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ef50a1fa-1482-45ab-83c3-dd00eec3cdcc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:13.871514 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ef50a1fa-1482-45ab-83c3-dd00eec3cdcc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:13.872490 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ef50a1fa-1482-45ab-83c3-dd00eec3cdcc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:13.872976 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ef50a1fa-1482-45ab-83c3-dd00eec3cdcc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:14.102479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ef50a1fa-1482-45ab-83c3-dd00eec3cdcc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:14.122612 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ef50a1fa-1482-45ab-83c3-dd00eec3cdcc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.264498 Jun 16 14:58:14.123203 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 94/167] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:13 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:14.414881 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bf2f898d-e1fe-4647-a347-c98d53c827a9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:14.416337 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bf2f898d-e1fe-4647-a347-c98d53c827a9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:14.424168 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bf2f898d-e1fe-4647-a347-c98d53c827a9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:14.425107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bf2f898d-e1fe-4647-a347-c98d53c827a9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:14.426536 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bf2f898d-e1fe-4647-a347-c98d53c827a9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:14.427406 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bf2f898d-e1fe-4647-a347-c98d53c827a9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:14.729594 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-88a9b4f3-0ab9-4b77-934b-26b059628332 req-58119471-b0c7-4f14-9c06-a9968a2d9124 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "133e2287-518a-4c4e-bb51-8790ed7647a7", "tag": "ea6268ec-2917-4b9f-ac8d-bc4237b637d9"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:14.739888 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bf2f898d-e1fe-4647-a347-c98d53c827a9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:14.751300 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bf2f898d-e1fe-4647-a347-c98d53c827a9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.342738 Jun 16 14:58:14.753739 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 74/168] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:14 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:14.756809 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-88a9b4f3-0ab9-4b77-934b-26b059628332 req-58119471-b0c7-4f14-9c06-a9968a2d9124 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:14.757568 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-88a9b4f3-0ab9-4b77-934b-26b059628332 req-58119471-b0c7-4f14-9c06-a9968a2d9124 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:14.781957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-88a9b4f3-0ab9-4b77-934b-26b059628332 req-58119471-b0c7-4f14-9c06-a9968a2d9124 service nova] Creating event network-changed:ea6268ec-2917-4b9f-ac8d-bc4237b637d9 for instance 133e2287-518a-4c4e-bb51-8790ed7647a7 on hv-cinder-83716 Jun 16 14:58:14.788724 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-88a9b4f3-0ab9-4b77-934b-26b059628332 req-58119471-b0c7-4f14-9c06-a9968a2d9124 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063163 Jun 16 14:58:14.790186 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 95/169] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 14:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:58:14.885507 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9ad10adb-db32-4bab-985c-e4a79f8feef3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:14.896833 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9ad10adb-db32-4bab-985c-e4a79f8feef3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:14.897579 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-140db23b-bfb0-44f3-8a01-dadff13939b7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:14.904676 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-140db23b-bfb0-44f3-8a01-dadff13939b7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:14.916309 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9ad10adb-db32-4bab-985c-e4a79f8feef3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:14.917221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9ad10adb-db32-4bab-985c-e4a79f8feef3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:14.918187 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9ad10adb-db32-4bab-985c-e4a79f8feef3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:14.918708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9ad10adb-db32-4bab-985c-e4a79f8feef3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:14.921319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-140db23b-bfb0-44f3-8a01-dadff13939b7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:14.922146 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-140db23b-bfb0-44f3-8a01-dadff13939b7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:14.923086 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-140db23b-bfb0-44f3-8a01-dadff13939b7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:14.925239 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-140db23b-bfb0-44f3-8a01-dadff13939b7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:15.100995 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9ad10adb-db32-4bab-985c-e4a79f8feef3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:15.110072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9ad10adb-db32-4bab-985c-e4a79f8feef3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:15.112239 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9ad10adb-db32-4bab-985c-e4a79f8feef3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:15.113460 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9ad10adb-db32-4bab-985c-e4a79f8feef3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.232345 Jun 16 14:58:15.114028 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 75/170] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:14 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:58:15.116962 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-140db23b-bfb0-44f3-8a01-dadff13939b7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:15.125331 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-140db23b-bfb0-44f3-8a01-dadff13939b7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.234671 Jun 16 14:58:15.126267 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 96/171] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:14 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:15.157649 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-923647a8-e6af-471f-a352-a7524966650f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:15.160157 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-923647a8-e6af-471f-a352-a7524966650f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:15.169203 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-923647a8-e6af-471f-a352-a7524966650f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:15.169667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-923647a8-e6af-471f-a352-a7524966650f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:15.170459 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-923647a8-e6af-471f-a352-a7524966650f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:15.170903 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-923647a8-e6af-471f-a352-a7524966650f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:15.325316 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-923647a8-e6af-471f-a352-a7524966650f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:15.333543 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-923647a8-e6af-471f-a352-a7524966650f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.185800 Jun 16 14:58:15.334121 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 76/172] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:15 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:15.770700 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ebcfff31-eaf6-4671-a3ac-b6972210eb68 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:15.771362 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ebcfff31-eaf6-4671-a3ac-b6972210eb68 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:15.780176 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ebcfff31-eaf6-4671-a3ac-b6972210eb68 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:15.781228 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ebcfff31-eaf6-4671-a3ac-b6972210eb68 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:15.781510 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ebcfff31-eaf6-4671-a3ac-b6972210eb68 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:15.781965 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ebcfff31-eaf6-4671-a3ac-b6972210eb68 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:15.952233 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ebcfff31-eaf6-4671-a3ac-b6972210eb68 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:15.960557 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ebcfff31-eaf6-4671-a3ac-b6972210eb68 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.194103 Jun 16 14:58:15.961172 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 97/173] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:15 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:16.134546 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9f8f6436-fdcd-4cc5-a5d4-13af775ef032 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:16.135143 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9f8f6436-fdcd-4cc5-a5d4-13af775ef032 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:16.142450 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9f8f6436-fdcd-4cc5-a5d4-13af775ef032 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:16.142906 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9f8f6436-fdcd-4cc5-a5d4-13af775ef032 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:16.143674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9f8f6436-fdcd-4cc5-a5d4-13af775ef032 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:16.144107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9f8f6436-fdcd-4cc5-a5d4-13af775ef032 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:16.144333 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e01a3234-5863-4bdf-b6df-60de4d6fb9ea tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:16.145002 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e01a3234-5863-4bdf-b6df-60de4d6fb9ea tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:16.152580 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e01a3234-5863-4bdf-b6df-60de4d6fb9ea tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:16.153294 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e01a3234-5863-4bdf-b6df-60de4d6fb9ea tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:16.154572 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e01a3234-5863-4bdf-b6df-60de4d6fb9ea tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:16.155071 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e01a3234-5863-4bdf-b6df-60de4d6fb9ea tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:16.307237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9f8f6436-fdcd-4cc5-a5d4-13af775ef032 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:16.317575 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9f8f6436-fdcd-4cc5-a5d4-13af775ef032 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:16.319223 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9f8f6436-fdcd-4cc5-a5d4-13af775ef032 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:16.320575 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9f8f6436-fdcd-4cc5-a5d4-13af775ef032 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.189975 Jun 16 14:58:16.321832 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 77/174] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:16 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:16.340887 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e01a3234-5863-4bdf-b6df-60de4d6fb9ea tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:16.348578 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e01a3234-5863-4bdf-b6df-60de4d6fb9ea tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.208337 Jun 16 14:58:16.349688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 98/175] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:16 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:16.358167 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c9f8e6ff-c123-4ea7-8ac4-30786ff4bafe tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:16.358743 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c9f8e6ff-c123-4ea7-8ac4-30786ff4bafe tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:16.365827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9f8e6ff-c123-4ea7-8ac4-30786ff4bafe tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:16.366284 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9f8e6ff-c123-4ea7-8ac4-30786ff4bafe tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:16.367150 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9f8e6ff-c123-4ea7-8ac4-30786ff4bafe tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:16.367511 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9f8e6ff-c123-4ea7-8ac4-30786ff4bafe tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:16.386781 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:16.522765 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c9f8e6ff-c123-4ea7-8ac4-30786ff4bafe tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:16.536473 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c9f8e6ff-c123-4ea7-8ac4-30786ff4bafe tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.189096 Jun 16 14:58:16.537185 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 78/176] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:16 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:16.982054 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2a67b061-882a-42bd-82d2-ba06f96cc8aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:16.982659 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2a67b061-882a-42bd-82d2-ba06f96cc8aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:16.991629 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a67b061-882a-42bd-82d2-ba06f96cc8aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:16.992388 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a67b061-882a-42bd-82d2-ba06f96cc8aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:16.993224 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a67b061-882a-42bd-82d2-ba06f96cc8aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:16.993679 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a67b061-882a-42bd-82d2-ba06f96cc8aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:17.127323 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2a67b061-882a-42bd-82d2-ba06f96cc8aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:17.135345 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2a67b061-882a-42bd-82d2-ba06f96cc8aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.157570 Jun 16 14:58:17.135954 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 99/177] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:16 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:17.343090 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e2844786-124a-4468-9af1-de3f57a03e92 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:17.343706 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e2844786-124a-4468-9af1-de3f57a03e92 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:17.345761 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=92 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:17.351292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2844786-124a-4468-9af1-de3f57a03e92 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:17.351748 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2844786-124a-4468-9af1-de3f57a03e92 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:17.352540 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2844786-124a-4468-9af1-de3f57a03e92 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:17.353065 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2844786-124a-4468-9af1-de3f57a03e92 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:17.366834 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4992ac94-eeda-4edb-8df4-c33cf4dcbb5a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:17.367445 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4992ac94-eeda-4edb-8df4-c33cf4dcbb5a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:17.374628 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4992ac94-eeda-4edb-8df4-c33cf4dcbb5a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:17.375080 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4992ac94-eeda-4edb-8df4-c33cf4dcbb5a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:17.375903 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4992ac94-eeda-4edb-8df4-c33cf4dcbb5a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:17.376341 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4992ac94-eeda-4edb-8df4-c33cf4dcbb5a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:17.491206 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e2844786-124a-4468-9af1-de3f57a03e92 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:17.501174 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e2844786-124a-4468-9af1-de3f57a03e92 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:17.502838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e2844786-124a-4468-9af1-de3f57a03e92 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:17.504072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e2844786-124a-4468-9af1-de3f57a03e92 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.164973 Jun 16 14:58:17.504727 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 79/178] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:17 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:17.525908 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4992ac94-eeda-4edb-8df4-c33cf4dcbb5a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:17.536082 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4992ac94-eeda-4edb-8df4-c33cf4dcbb5a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.173018 Jun 16 14:58:17.536649 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 100/179] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:17 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:17.556408 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-65a06a9a-4ab2-4fa9-86b8-1542cff2c9a2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:17.557057 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-65a06a9a-4ab2-4fa9-86b8-1542cff2c9a2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:17.563196 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-65a06a9a-4ab2-4fa9-86b8-1542cff2c9a2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:17.563650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-65a06a9a-4ab2-4fa9-86b8-1542cff2c9a2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:17.564426 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-65a06a9a-4ab2-4fa9-86b8-1542cff2c9a2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:17.564908 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-65a06a9a-4ab2-4fa9-86b8-1542cff2c9a2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:17.701000 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-65a06a9a-4ab2-4fa9-86b8-1542cff2c9a2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:17.709411 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-65a06a9a-4ab2-4fa9-86b8-1542cff2c9a2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.157398 Jun 16 14:58:17.710067 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 80/180] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:17 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:18.151584 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e1fdd324-8109-40d8-9e8b-76aa481d2321 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:18.152444 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e1fdd324-8109-40d8-9e8b-76aa481d2321 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:18.158691 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e1fdd324-8109-40d8-9e8b-76aa481d2321 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:18.159134 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e1fdd324-8109-40d8-9e8b-76aa481d2321 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:18.159887 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e1fdd324-8109-40d8-9e8b-76aa481d2321 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:18.160312 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e1fdd324-8109-40d8-9e8b-76aa481d2321 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:18.302922 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e1fdd324-8109-40d8-9e8b-76aa481d2321 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:18.311208 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e1fdd324-8109-40d8-9e8b-76aa481d2321 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.163532 Jun 16 14:58:18.311784 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 101/181] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:18 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:18.522381 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-13f8dc70-6a7e-456e-8b8d-09cec46a3a42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:18.522933 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-13f8dc70-6a7e-456e-8b8d-09cec46a3a42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:18.530628 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-13f8dc70-6a7e-456e-8b8d-09cec46a3a42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:18.531145 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-13f8dc70-6a7e-456e-8b8d-09cec46a3a42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:18.531967 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-13f8dc70-6a7e-456e-8b8d-09cec46a3a42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:18.532456 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-13f8dc70-6a7e-456e-8b8d-09cec46a3a42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:18.554352 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-52401e48-c8fb-4b24-8628-617625a2904e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:18.555239 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-52401e48-c8fb-4b24-8628-617625a2904e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:18.561875 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52401e48-c8fb-4b24-8628-617625a2904e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:18.562321 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52401e48-c8fb-4b24-8628-617625a2904e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:18.563078 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52401e48-c8fb-4b24-8628-617625a2904e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:18.563613 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52401e48-c8fb-4b24-8628-617625a2904e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:18.681640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-13f8dc70-6a7e-456e-8b8d-09cec46a3a42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:18.689967 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-13f8dc70-6a7e-456e-8b8d-09cec46a3a42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:18.691584 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-13f8dc70-6a7e-456e-8b8d-09cec46a3a42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:18.692780 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-13f8dc70-6a7e-456e-8b8d-09cec46a3a42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.174376 Jun 16 14:58:18.693329 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 81/182] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:18 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:18.705206 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-52401e48-c8fb-4b24-8628-617625a2904e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:18.713438 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-52401e48-c8fb-4b24-8628-617625a2904e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.163051 Jun 16 14:58:18.714019 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 102/183] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:18 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:18.732308 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bd944c60-c0d4-41cb-b213-7e99173e876e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:18.732988 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bd944c60-c0d4-41cb-b213-7e99173e876e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:18.739201 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bd944c60-c0d4-41cb-b213-7e99173e876e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:18.739683 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bd944c60-c0d4-41cb-b213-7e99173e876e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:18.740463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bd944c60-c0d4-41cb-b213-7e99173e876e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:18.740944 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bd944c60-c0d4-41cb-b213-7e99173e876e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:18.902800 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bd944c60-c0d4-41cb-b213-7e99173e876e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:18.910714 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bd944c60-c0d4-41cb-b213-7e99173e876e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.182919 Jun 16 14:58:18.911295 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 82/184] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:18 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:19.328357 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f82de8d4-979c-486b-836e-6c9a6ebd8958 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:19.328995 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f82de8d4-979c-486b-836e-6c9a6ebd8958 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:19.335165 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f82de8d4-979c-486b-836e-6c9a6ebd8958 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:19.335613 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f82de8d4-979c-486b-836e-6c9a6ebd8958 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:19.336381 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f82de8d4-979c-486b-836e-6c9a6ebd8958 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:19.336809 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f82de8d4-979c-486b-836e-6c9a6ebd8958 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:19.478921 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f82de8d4-979c-486b-836e-6c9a6ebd8958 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:19.486873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f82de8d4-979c-486b-836e-6c9a6ebd8958 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.162381 Jun 16 14:58:19.487450 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 103/185] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:19 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:19.711189 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-66b637a4-b7cc-422b-a2ae-6eb6c3fe55e0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:19.711810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-66b637a4-b7cc-422b-a2ae-6eb6c3fe55e0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:19.718237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-66b637a4-b7cc-422b-a2ae-6eb6c3fe55e0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:19.718691 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-66b637a4-b7cc-422b-a2ae-6eb6c3fe55e0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:19.719478 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-66b637a4-b7cc-422b-a2ae-6eb6c3fe55e0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:19.719947 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-66b637a4-b7cc-422b-a2ae-6eb6c3fe55e0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:19.731085 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-91d96c1d-c134-4916-bd08-eb44551ae562 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:19.731805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-91d96c1d-c134-4916-bd08-eb44551ae562 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:19.738308 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-91d96c1d-c134-4916-bd08-eb44551ae562 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:19.738757 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-91d96c1d-c134-4916-bd08-eb44551ae562 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:19.739532 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-91d96c1d-c134-4916-bd08-eb44551ae562 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:19.739979 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-91d96c1d-c134-4916-bd08-eb44551ae562 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:19.888717 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-66b637a4-b7cc-422b-a2ae-6eb6c3fe55e0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:19.901807 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-66b637a4-b7cc-422b-a2ae-6eb6c3fe55e0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:19.904186 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-66b637a4-b7cc-422b-a2ae-6eb6c3fe55e0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:19.905452 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-66b637a4-b7cc-422b-a2ae-6eb6c3fe55e0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.198596 Jun 16 14:58:19.906252 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 83/186] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:19 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:19.922999 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-91d96c1d-c134-4916-bd08-eb44551ae562 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:19.927443 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f1032ec6-9b92-463f-9c08-15015632c9aa tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:19.932066 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-91d96c1d-c134-4916-bd08-eb44551ae562 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.205290 Jun 16 14:58:19.932638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 104/187] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:19 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:19.935060 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f1032ec6-9b92-463f-9c08-15015632c9aa tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:19.941674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f1032ec6-9b92-463f-9c08-15015632c9aa tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:19.942120 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f1032ec6-9b92-463f-9c08-15015632c9aa tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:19.942883 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f1032ec6-9b92-463f-9c08-15015632c9aa tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:19.943313 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f1032ec6-9b92-463f-9c08-15015632c9aa tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:20.107561 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f1032ec6-9b92-463f-9c08-15015632c9aa tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:20.115416 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f1032ec6-9b92-463f-9c08-15015632c9aa tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.191782 Jun 16 14:58:20.127438 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 84/188] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:19 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:20.505172 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f60d0164-1f61-4f5c-b930-1431bd089418 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:20.505853 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f60d0164-1f61-4f5c-b930-1431bd089418 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:20.512941 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f60d0164-1f61-4f5c-b930-1431bd089418 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:20.513395 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f60d0164-1f61-4f5c-b930-1431bd089418 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:20.514183 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f60d0164-1f61-4f5c-b930-1431bd089418 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:20.514620 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f60d0164-1f61-4f5c-b930-1431bd089418 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:20.657124 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f60d0164-1f61-4f5c-b930-1431bd089418 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:20.664962 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f60d0164-1f61-4f5c-b930-1431bd089418 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.163577 Jun 16 14:58:20.665555 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 105/189] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:20 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:20.923863 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-cdf8746e-1a71-4200-93b1-1436061336f9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:20.924560 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-cdf8746e-1a71-4200-93b1-1436061336f9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:20.931811 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cdf8746e-1a71-4200-93b1-1436061336f9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:20.932197 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cdf8746e-1a71-4200-93b1-1436061336f9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:20.932988 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cdf8746e-1a71-4200-93b1-1436061336f9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:20.933423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cdf8746e-1a71-4200-93b1-1436061336f9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:20.955618 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-933ca498-e128-4770-b65c-2cd53c486501 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:20.956610 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-933ca498-e128-4770-b65c-2cd53c486501 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:20.964425 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-933ca498-e128-4770-b65c-2cd53c486501 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:20.965014 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-933ca498-e128-4770-b65c-2cd53c486501 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:20.969573 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-933ca498-e128-4770-b65c-2cd53c486501 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:20.969573 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-933ca498-e128-4770-b65c-2cd53c486501 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:21.099530 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-cdf8746e-1a71-4200-93b1-1436061336f9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:21.107930 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-cdf8746e-1a71-4200-93b1-1436061336f9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:21.112901 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-cdf8746e-1a71-4200-93b1-1436061336f9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:21.112901 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-cdf8746e-1a71-4200-93b1-1436061336f9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.190794 Jun 16 14:58:21.112901 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 85/190] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:20 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:21.117724 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-933ca498-e128-4770-b65c-2cd53c486501 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:21.129187 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-933ca498-e128-4770-b65c-2cd53c486501 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.178731 Jun 16 14:58:21.129756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 106/191] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:20 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:21.138655 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2acb3466-c951-405e-a298-ebabd304837e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:21.139269 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2acb3466-c951-405e-a298-ebabd304837e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:21.145517 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2acb3466-c951-405e-a298-ebabd304837e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:21.145964 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2acb3466-c951-405e-a298-ebabd304837e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:21.146734 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2acb3466-c951-405e-a298-ebabd304837e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:21.147182 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2acb3466-c951-405e-a298-ebabd304837e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:21.284832 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2acb3466-c951-405e-a298-ebabd304837e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:21.293651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2acb3466-c951-405e-a298-ebabd304837e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.160009 Jun 16 14:58:21.294245 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 86/192] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:21 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:21.681188 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-946d50bd-dae6-4271-8929-8696947f7e32 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:21.681792 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-946d50bd-dae6-4271-8929-8696947f7e32 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:21.688183 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-946d50bd-dae6-4271-8929-8696947f7e32 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:21.688635 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-946d50bd-dae6-4271-8929-8696947f7e32 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:21.689442 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-946d50bd-dae6-4271-8929-8696947f7e32 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:21.689935 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-946d50bd-dae6-4271-8929-8696947f7e32 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:21.829797 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-946d50bd-dae6-4271-8929-8696947f7e32 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:21.837868 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-946d50bd-dae6-4271-8929-8696947f7e32 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.160459 Jun 16 14:58:21.838454 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 107/193] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:21 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:22.131904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2cd9092a-2738-49db-b92d-f3b1d2cfb9fa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:22.132520 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2cd9092a-2738-49db-b92d-f3b1d2cfb9fa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:22.139019 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2cd9092a-2738-49db-b92d-f3b1d2cfb9fa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:22.139472 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2cd9092a-2738-49db-b92d-f3b1d2cfb9fa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:22.140471 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2cd9092a-2738-49db-b92d-f3b1d2cfb9fa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:22.140868 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2cd9092a-2738-49db-b92d-f3b1d2cfb9fa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:22.147665 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5cb8e84d-32ce-4b4c-b45c-8c2d58fe192a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:22.148312 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5cb8e84d-32ce-4b4c-b45c-8c2d58fe192a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:22.154894 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5cb8e84d-32ce-4b4c-b45c-8c2d58fe192a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:22.155348 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5cb8e84d-32ce-4b4c-b45c-8c2d58fe192a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:22.156127 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5cb8e84d-32ce-4b4c-b45c-8c2d58fe192a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:22.156575 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5cb8e84d-32ce-4b4c-b45c-8c2d58fe192a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:22.284011 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2cd9092a-2738-49db-b92d-f3b1d2cfb9fa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:22.293254 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2cd9092a-2738-49db-b92d-f3b1d2cfb9fa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:22.294765 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2cd9092a-2738-49db-b92d-f3b1d2cfb9fa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:22.295902 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2cd9092a-2738-49db-b92d-f3b1d2cfb9fa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.170290 Jun 16 14:58:22.302870 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 87/194] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:22 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:22.303174 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5cb8e84d-32ce-4b4c-b45c-8c2d58fe192a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:22.309959 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5cb8e84d-32ce-4b4c-b45c-8c2d58fe192a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.166025 Jun 16 14:58:22.310665 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 108/195] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:22 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:22.310987 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0d501b19-f9fb-4a2b-87b3-128a5786216c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:22.311615 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0d501b19-f9fb-4a2b-87b3-128a5786216c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:22.318242 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0d501b19-f9fb-4a2b-87b3-128a5786216c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:22.318695 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0d501b19-f9fb-4a2b-87b3-128a5786216c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:22.319483 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0d501b19-f9fb-4a2b-87b3-128a5786216c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:22.319919 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0d501b19-f9fb-4a2b-87b3-128a5786216c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:22.458637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0d501b19-f9fb-4a2b-87b3-128a5786216c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:22.467983 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0d501b19-f9fb-4a2b-87b3-128a5786216c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.161137 Jun 16 14:58:22.468578 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 88/196] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:22 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:22.854745 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-31f2af96-054e-474b-a510-e68c93676a1b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:22.855425 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-31f2af96-054e-474b-a510-e68c93676a1b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:22.862177 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-31f2af96-054e-474b-a510-e68c93676a1b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:22.862625 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-31f2af96-054e-474b-a510-e68c93676a1b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:22.863407 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-31f2af96-054e-474b-a510-e68c93676a1b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:22.863851 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-31f2af96-054e-474b-a510-e68c93676a1b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:23.008570 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-31f2af96-054e-474b-a510-e68c93676a1b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:23.017543 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-31f2af96-054e-474b-a510-e68c93676a1b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.166687 Jun 16 14:58:23.018164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 109/197] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:22 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:23.315897 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-82c4ee32-6658-4aaa-8f9f-1f359d5fd725 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:23.316609 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-82c4ee32-6658-4aaa-8f9f-1f359d5fd725 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:23.323923 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82c4ee32-6658-4aaa-8f9f-1f359d5fd725 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:23.324388 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82c4ee32-6658-4aaa-8f9f-1f359d5fd725 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:23.325202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82c4ee32-6658-4aaa-8f9f-1f359d5fd725 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:23.325641 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82c4ee32-6658-4aaa-8f9f-1f359d5fd725 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:23.327766 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-bd0a199f-02ae-4472-9088-173057950419 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:23.328371 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-bd0a199f-02ae-4472-9088-173057950419 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:23.334544 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bd0a199f-02ae-4472-9088-173057950419 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:23.334993 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bd0a199f-02ae-4472-9088-173057950419 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:23.335745 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bd0a199f-02ae-4472-9088-173057950419 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:23.336180 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bd0a199f-02ae-4472-9088-173057950419 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:23.359071 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:23.496173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-82c4ee32-6658-4aaa-8f9f-1f359d5fd725 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:23.501706 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bd0a199f-02ae-4472-9088-173057950419 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:23.505251 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-82c4ee32-6658-4aaa-8f9f-1f359d5fd725 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:23.508559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-82c4ee32-6658-4aaa-8f9f-1f359d5fd725 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:23.510149 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-82c4ee32-6658-4aaa-8f9f-1f359d5fd725 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.198705 Jun 16 14:58:23.516349 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-bd0a199f-02ae-4472-9088-173057950419 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.191962 Jun 16 14:58:23.517730 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 110/198] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:23 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:23.520478 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 89/199] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:23 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:23.527418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b6fa07a9-c479-41b1-89b3-ca1480d13390 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:23.528236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b6fa07a9-c479-41b1-89b3-ca1480d13390 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:23.534945 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b6fa07a9-c479-41b1-89b3-ca1480d13390 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:23.535405 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b6fa07a9-c479-41b1-89b3-ca1480d13390 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:23.536248 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b6fa07a9-c479-41b1-89b3-ca1480d13390 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:23.536711 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b6fa07a9-c479-41b1-89b3-ca1480d13390 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:23.688206 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b6fa07a9-c479-41b1-89b3-ca1480d13390 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:23.699144 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b6fa07a9-c479-41b1-89b3-ca1480d13390 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.179744 Jun 16 14:58:23.699728 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 111/200] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:23 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:24.036080 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b3ee8a86-b890-4b81-b664-d35cb0961f2f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:24.036683 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b3ee8a86-b890-4b81-b664-d35cb0961f2f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:24.042944 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3ee8a86-b890-4b81-b664-d35cb0961f2f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:24.043386 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3ee8a86-b890-4b81-b664-d35cb0961f2f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:24.044145 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3ee8a86-b890-4b81-b664-d35cb0961f2f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:24.044589 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3ee8a86-b890-4b81-b664-d35cb0961f2f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:24.210854 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b3ee8a86-b890-4b81-b664-d35cb0961f2f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:24.219240 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b3ee8a86-b890-4b81-b664-d35cb0961f2f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.187029 Jun 16 14:58:24.219805 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 90/201] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:24 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:24.528895 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6df1cfcc-05c5-4386-aa51-6d8e20624e44 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:24.529453 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6df1cfcc-05c5-4386-aa51-6d8e20624e44 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:24.534810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fe8c1715-a12e-4aef-9dc9-a4d18267950f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:24.535431 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fe8c1715-a12e-4aef-9dc9-a4d18267950f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:24.536213 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6df1cfcc-05c5-4386-aa51-6d8e20624e44 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:24.537009 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6df1cfcc-05c5-4386-aa51-6d8e20624e44 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:24.537796 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6df1cfcc-05c5-4386-aa51-6d8e20624e44 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:24.538237 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6df1cfcc-05c5-4386-aa51-6d8e20624e44 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:24.542526 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fe8c1715-a12e-4aef-9dc9-a4d18267950f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:24.543012 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fe8c1715-a12e-4aef-9dc9-a4d18267950f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:24.543735 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fe8c1715-a12e-4aef-9dc9-a4d18267950f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:24.545063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fe8c1715-a12e-4aef-9dc9-a4d18267950f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:24.690910 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-fe8c1715-a12e-4aef-9dc9-a4d18267950f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:24.696937 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6df1cfcc-05c5-4386-aa51-6d8e20624e44 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:24.699687 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fe8c1715-a12e-4aef-9dc9-a4d18267950f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.169336 Jun 16 14:58:24.700277 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 91/202] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:24 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:24.705337 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6df1cfcc-05c5-4386-aa51-6d8e20624e44 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:24.706843 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6df1cfcc-05c5-4386-aa51-6d8e20624e44 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:24.708249 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6df1cfcc-05c5-4386-aa51-6d8e20624e44 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.184270 Jun 16 14:58:24.708820 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 112/203] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:24 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:24.720152 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ba4a6f3a-72ed-413c-ad3a-66e018efa22d tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:24.721339 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ba4a6f3a-72ed-413c-ad3a-66e018efa22d tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:24.729503 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ba4a6f3a-72ed-413c-ad3a-66e018efa22d tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:24.729952 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ba4a6f3a-72ed-413c-ad3a-66e018efa22d tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:24.730730 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ba4a6f3a-72ed-413c-ad3a-66e018efa22d tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:24.731168 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ba4a6f3a-72ed-413c-ad3a-66e018efa22d tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:24.870519 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ba4a6f3a-72ed-413c-ad3a-66e018efa22d tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:24.878423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ba4a6f3a-72ed-413c-ad3a-66e018efa22d tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.163682 Jun 16 14:58:24.878994 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 92/204] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:24 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:25.235793 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-26bc25f3-6a1e-4ecd-a4ee-e13a9fcf09aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:25.236437 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-26bc25f3-6a1e-4ecd-a4ee-e13a9fcf09aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:25.242697 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-26bc25f3-6a1e-4ecd-a4ee-e13a9fcf09aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:25.243182 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-26bc25f3-6a1e-4ecd-a4ee-e13a9fcf09aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:25.243962 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-26bc25f3-6a1e-4ecd-a4ee-e13a9fcf09aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:25.244396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-26bc25f3-6a1e-4ecd-a4ee-e13a9fcf09aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:25.388096 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-26bc25f3-6a1e-4ecd-a4ee-e13a9fcf09aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:25.400487 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-26bc25f3-6a1e-4ecd-a4ee-e13a9fcf09aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.166630 Jun 16 14:58:25.400487 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 113/205] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:25 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:25.721749 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-24c1232e-6214-4226-8990-dc2102c1741f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:25.722370 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-24c1232e-6214-4226-8990-dc2102c1741f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:25.729637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24c1232e-6214-4226-8990-dc2102c1741f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:25.730095 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24c1232e-6214-4226-8990-dc2102c1741f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:25.730871 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24c1232e-6214-4226-8990-dc2102c1741f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:25.731485 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24c1232e-6214-4226-8990-dc2102c1741f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:25.731913 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-677b5cdb-56e0-4c92-aa70-fd2520d5e6c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:25.732538 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-677b5cdb-56e0-4c92-aa70-fd2520d5e6c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:25.740914 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-677b5cdb-56e0-4c92-aa70-fd2520d5e6c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:25.741379 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-677b5cdb-56e0-4c92-aa70-fd2520d5e6c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:25.742165 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-677b5cdb-56e0-4c92-aa70-fd2520d5e6c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:25.742603 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-677b5cdb-56e0-4c92-aa70-fd2520d5e6c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:25.968492 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-24c1232e-6214-4226-8990-dc2102c1741f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:25.971397 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-677b5cdb-56e0-4c92-aa70-fd2520d5e6c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:25.984230 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-24c1232e-6214-4226-8990-dc2102c1741f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.266190 Jun 16 14:58:25.985052 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 93/206] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:25 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:25.990629 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-677b5cdb-56e0-4c92-aa70-fd2520d5e6c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:25.992745 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-677b5cdb-56e0-4c92-aa70-fd2520d5e6c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:25.994656 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-677b5cdb-56e0-4c92-aa70-fd2520d5e6c8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.267202 Jun 16 14:58:26.006129 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 114/207] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:25 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:26.011462 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-10262490-9dc7-4782-8055-5c36cbdffd66 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:26.012245 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-10262490-9dc7-4782-8055-5c36cbdffd66 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:26.019265 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-201a1dbb-aee4-4d99-bae5-655a57c504bb req-4c64622e-07ae-4d0e-8a20-8ade446ef28d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822acf52-490b-49b9-b85f-db02cc41a0bf", "name": "network-vif-plugged", "status": "completed", "tag": "63cdf77a-1418-4eaf-8ecb-70cb8c2c86ac"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:26.027359 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-10262490-9dc7-4782-8055-5c36cbdffd66 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:26.027972 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-10262490-9dc7-4782-8055-5c36cbdffd66 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:26.028898 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-10262490-9dc7-4782-8055-5c36cbdffd66 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:26.029355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-10262490-9dc7-4782-8055-5c36cbdffd66 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:26.030853 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-201a1dbb-aee4-4d99-bae5-655a57c504bb req-4c64622e-07ae-4d0e-8a20-8ade446ef28d service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:26.031641 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-201a1dbb-aee4-4d99-bae5-655a57c504bb req-4c64622e-07ae-4d0e-8a20-8ade446ef28d service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:26.059903 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-201a1dbb-aee4-4d99-bae5-655a57c504bb req-4c64622e-07ae-4d0e-8a20-8ade446ef28d service nova] Creating event network-vif-plugged:63cdf77a-1418-4eaf-8ecb-70cb8c2c86ac for instance 822acf52-490b-49b9-b85f-db02cc41a0bf on hv-cinder-83716 Jun 16 14:58:26.066000 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-201a1dbb-aee4-4d99-bae5-655a57c504bb req-4c64622e-07ae-4d0e-8a20-8ade446ef28d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055861 Jun 16 14:58:26.066601 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 115/208] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 14:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:58:26.204074 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-10262490-9dc7-4782-8055-5c36cbdffd66 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:26.212622 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-10262490-9dc7-4782-8055-5c36cbdffd66 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.210580 Jun 16 14:58:26.213229 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 94/209] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:25 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:26.418102 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-305e4629-31af-4d41-8bef-75f49c1ccce6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:26.418945 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-305e4629-31af-4d41-8bef-75f49c1ccce6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:26.428434 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-305e4629-31af-4d41-8bef-75f49c1ccce6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:26.428993 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-305e4629-31af-4d41-8bef-75f49c1ccce6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:26.430032 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-305e4629-31af-4d41-8bef-75f49c1ccce6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:26.430761 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-305e4629-31af-4d41-8bef-75f49c1ccce6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:26.981309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-305e4629-31af-4d41-8bef-75f49c1ccce6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:27.011405 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-305e4629-31af-4d41-8bef-75f49c1ccce6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.598476 Jun 16 14:58:27.014378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-88c780ef-9731-4c89-9976-d0375a027fa4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:27.018059 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-88c780ef-9731-4c89-9976-d0375a027fa4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:27.023186 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 116/210] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:26 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:27.031428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-88c780ef-9731-4c89-9976-d0375a027fa4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:27.031970 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-88c780ef-9731-4c89-9976-d0375a027fa4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:27.033565 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-88c780ef-9731-4c89-9976-d0375a027fa4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:27.034318 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-88c780ef-9731-4c89-9976-d0375a027fa4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:27.034722 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-bb0f0e00-d3e8-443b-a779-5c952333a315 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:27.035578 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-bb0f0e00-d3e8-443b-a779-5c952333a315 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:27.041721 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:27.045783 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bb0f0e00-d3e8-443b-a779-5c952333a315 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:27.046577 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bb0f0e00-d3e8-443b-a779-5c952333a315 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:27.047598 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bb0f0e00-d3e8-443b-a779-5c952333a315 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:27.048236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bb0f0e00-d3e8-443b-a779-5c952333a315 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:27.286914 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bb0f0e00-d3e8-443b-a779-5c952333a315 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:27.301920 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bb0f0e00-d3e8-443b-a779-5c952333a315 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:27.303693 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bb0f0e00-d3e8-443b-a779-5c952333a315 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:27.305098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-bb0f0e00-d3e8-443b-a779-5c952333a315 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.279755 Jun 16 14:58:27.305713 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 117/211] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:27 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:27.306337 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-88c780ef-9731-4c89-9976-d0375a027fa4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:27.311565 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2fc6f72d-dcd1-4439-bf6a-64bc7540d862 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:27.312624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2fc6f72d-dcd1-4439-bf6a-64bc7540d862 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:27.317028 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-88c780ef-9731-4c89-9976-d0375a027fa4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.314449 Jun 16 14:58:27.322025 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 95/212] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:26 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:27.323896 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2fc6f72d-dcd1-4439-bf6a-64bc7540d862 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:27.324587 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2fc6f72d-dcd1-4439-bf6a-64bc7540d862 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:27.325814 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2fc6f72d-dcd1-4439-bf6a-64bc7540d862 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:27.326401 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2fc6f72d-dcd1-4439-bf6a-64bc7540d862 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:27.495357 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2fc6f72d-dcd1-4439-bf6a-64bc7540d862 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:27.503330 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2fc6f72d-dcd1-4439-bf6a-64bc7540d862 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.196226 Jun 16 14:58:27.504319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 118/213] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:27 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:28.030680 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-716321f2-889f-44b3-9037-7180192d88ba tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:28.031316 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-716321f2-889f-44b3-9037-7180192d88ba tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:28.043887 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-716321f2-889f-44b3-9037-7180192d88ba tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:28.044362 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-716321f2-889f-44b3-9037-7180192d88ba tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:28.045453 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-716321f2-889f-44b3-9037-7180192d88ba tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:28.045891 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-716321f2-889f-44b3-9037-7180192d88ba tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:28.213649 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-716321f2-889f-44b3-9037-7180192d88ba tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:28.234996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-716321f2-889f-44b3-9037-7180192d88ba tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.208486 Jun 16 14:58:28.236160 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 96/214] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:28 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:28.331672 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d9799a2e-2646-400a-84eb-b0c5fc8756c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:28.331672 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d9799a2e-2646-400a-84eb-b0c5fc8756c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:28.339617 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-de189363-2197-4940-9917-ea9afdd54edf tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:28.341026 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-de189363-2197-4940-9917-ea9afdd54edf tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:28.343484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d9799a2e-2646-400a-84eb-b0c5fc8756c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:28.344931 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d9799a2e-2646-400a-84eb-b0c5fc8756c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:28.346460 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d9799a2e-2646-400a-84eb-b0c5fc8756c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:28.348412 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-de189363-2197-4940-9917-ea9afdd54edf tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:28.349132 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-de189363-2197-4940-9917-ea9afdd54edf tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:28.350068 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-de189363-2197-4940-9917-ea9afdd54edf tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:28.350653 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-de189363-2197-4940-9917-ea9afdd54edf tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:28.360602 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d9799a2e-2646-400a-84eb-b0c5fc8756c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:28.549570 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d9799a2e-2646-400a-84eb-b0c5fc8756c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:28.559166 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d9799a2e-2646-400a-84eb-b0c5fc8756c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:28.560651 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d9799a2e-2646-400a-84eb-b0c5fc8756c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:28.562051 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d9799a2e-2646-400a-84eb-b0c5fc8756c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.242140 Jun 16 14:58:28.562947 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 119/215] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:28 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:28.568079 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0c2ee694-b3aa-498c-ab82-91fdd6da9c1b tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:28.568862 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0c2ee694-b3aa-498c-ab82-91fdd6da9c1b tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:28.576343 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c2ee694-b3aa-498c-ab82-91fdd6da9c1b tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:28.577188 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c2ee694-b3aa-498c-ab82-91fdd6da9c1b tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:28.578022 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c2ee694-b3aa-498c-ab82-91fdd6da9c1b tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:28.578543 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c2ee694-b3aa-498c-ab82-91fdd6da9c1b tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:28.634738 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-de189363-2197-4940-9917-ea9afdd54edf tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:28.654150 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-de189363-2197-4940-9917-ea9afdd54edf tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.319524 Jun 16 14:58:28.658616 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 97/216] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:28 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:28.768068 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0c2ee694-b3aa-498c-ab82-91fdd6da9c1b tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:28.779746 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0c2ee694-b3aa-498c-ab82-91fdd6da9c1b tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.215308 Jun 16 14:58:28.780426 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 120/217] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:28 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:29.263391 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9871deb8-0773-49b8-9a62-043a7b05a702 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:29.264383 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9871deb8-0773-49b8-9a62-043a7b05a702 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:29.275567 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9871deb8-0773-49b8-9a62-043a7b05a702 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:29.276384 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9871deb8-0773-49b8-9a62-043a7b05a702 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:29.278071 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9871deb8-0773-49b8-9a62-043a7b05a702 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:29.278861 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9871deb8-0773-49b8-9a62-043a7b05a702 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:29.471514 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9871deb8-0773-49b8-9a62-043a7b05a702 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:29.484789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9871deb8-0773-49b8-9a62-043a7b05a702 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.225734 Jun 16 14:58:29.485396 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 98/218] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:29 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:29.583005 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-77e7a698-be05-460b-a8fe-f17e13365d79 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:29.583606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-77e7a698-be05-460b-a8fe-f17e13365d79 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:29.590388 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-77e7a698-be05-460b-a8fe-f17e13365d79 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:29.590936 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-77e7a698-be05-460b-a8fe-f17e13365d79 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:29.591714 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-77e7a698-be05-460b-a8fe-f17e13365d79 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:29.592154 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-77e7a698-be05-460b-a8fe-f17e13365d79 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:29.676220 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b1193c73-d732-488d-bcad-e60dc877430c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:29.676832 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b1193c73-d732-488d-bcad-e60dc877430c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:29.685440 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b1193c73-d732-488d-bcad-e60dc877430c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:29.689224 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b1193c73-d732-488d-bcad-e60dc877430c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:29.691350 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b1193c73-d732-488d-bcad-e60dc877430c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:29.692686 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b1193c73-d732-488d-bcad-e60dc877430c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:29.776904 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-77e7a698-be05-460b-a8fe-f17e13365d79 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:29.795060 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-77e7a698-be05-460b-a8fe-f17e13365d79 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:29.796437 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-77e7a698-be05-460b-a8fe-f17e13365d79 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:29.797805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-77e7a698-be05-460b-a8fe-f17e13365d79 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.218916 Jun 16 14:58:29.798352 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 121/219] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:29 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:58:29.807121 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-212a00d3-79bc-461f-b18e-d96365920059 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:29.808455 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-212a00d3-79bc-461f-b18e-d96365920059 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:29.822988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-212a00d3-79bc-461f-b18e-d96365920059 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:29.824078 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-212a00d3-79bc-461f-b18e-d96365920059 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:29.825025 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-212a00d3-79bc-461f-b18e-d96365920059 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:29.825479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-212a00d3-79bc-461f-b18e-d96365920059 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:29.865194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b1193c73-d732-488d-bcad-e60dc877430c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:29.874519 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b1193c73-d732-488d-bcad-e60dc877430c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.202107 Jun 16 14:58:29.875512 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 99/220] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:29 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:29.991011 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-212a00d3-79bc-461f-b18e-d96365920059 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:29.999774 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-212a00d3-79bc-461f-b18e-d96365920059 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.199579 Jun 16 14:58:30.000361 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 122/221] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:29 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:30.502108 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-81e4b102-e491-4ef8-bbd0-e5e5df21b059 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:30.502850 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-81e4b102-e491-4ef8-bbd0-e5e5df21b059 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:30.510029 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-81e4b102-e491-4ef8-bbd0-e5e5df21b059 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:30.510404 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-81e4b102-e491-4ef8-bbd0-e5e5df21b059 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:30.511178 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-81e4b102-e491-4ef8-bbd0-e5e5df21b059 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:30.511619 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-81e4b102-e491-4ef8-bbd0-e5e5df21b059 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:30.668431 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-81e4b102-e491-4ef8-bbd0-e5e5df21b059 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:30.676810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-81e4b102-e491-4ef8-bbd0-e5e5df21b059 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.178489 Jun 16 14:58:30.677420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 100/222] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:30 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:30.815598 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2a34a9b8-711c-4de9-a5bc-02523a1cda91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:30.816448 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2a34a9b8-711c-4de9-a5bc-02523a1cda91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:30.823965 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a34a9b8-711c-4de9-a5bc-02523a1cda91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:30.824442 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a34a9b8-711c-4de9-a5bc-02523a1cda91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:30.825240 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a34a9b8-711c-4de9-a5bc-02523a1cda91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:30.825675 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a34a9b8-711c-4de9-a5bc-02523a1cda91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:30.891794 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b004c152-05d6-4b1a-9659-e11f87006344 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:30.892414 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b004c152-05d6-4b1a-9659-e11f87006344 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:30.899130 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b004c152-05d6-4b1a-9659-e11f87006344 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:30.899879 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b004c152-05d6-4b1a-9659-e11f87006344 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:30.900672 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b004c152-05d6-4b1a-9659-e11f87006344 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:30.901151 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b004c152-05d6-4b1a-9659-e11f87006344 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:30.983207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2a34a9b8-711c-4de9-a5bc-02523a1cda91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:30.993865 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2a34a9b8-711c-4de9-a5bc-02523a1cda91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:30.995960 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2a34a9b8-711c-4de9-a5bc-02523a1cda91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:30.997515 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2a34a9b8-711c-4de9-a5bc-02523a1cda91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.185734 Jun 16 14:58:30.998163 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 123/223] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:30 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:31.017759 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-df04b97d-9e3e-4707-84e1-a621c5d73631 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:31.018381 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-df04b97d-9e3e-4707-84e1-a621c5d73631 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:31.024950 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-df04b97d-9e3e-4707-84e1-a621c5d73631 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:31.025414 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-df04b97d-9e3e-4707-84e1-a621c5d73631 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:31.026200 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-df04b97d-9e3e-4707-84e1-a621c5d73631 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:31.026641 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-df04b97d-9e3e-4707-84e1-a621c5d73631 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:31.061899 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b004c152-05d6-4b1a-9659-e11f87006344 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:31.071808 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b004c152-05d6-4b1a-9659-e11f87006344 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.183003 Jun 16 14:58:31.072564 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 101/224] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:30 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:31.190949 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-df04b97d-9e3e-4707-84e1-a621c5d73631 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:31.204285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-df04b97d-9e3e-4707-84e1-a621c5d73631 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.190426 Jun 16 14:58:31.205495 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 124/225] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:31 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:31.698202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a47d180f-9613-48ea-85a2-e9f00d36ed76 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:31.698854 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a47d180f-9613-48ea-85a2-e9f00d36ed76 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:31.705176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a47d180f-9613-48ea-85a2-e9f00d36ed76 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:31.705634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a47d180f-9613-48ea-85a2-e9f00d36ed76 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:31.706446 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a47d180f-9613-48ea-85a2-e9f00d36ed76 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:31.706890 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a47d180f-9613-48ea-85a2-e9f00d36ed76 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:31.850144 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a47d180f-9613-48ea-85a2-e9f00d36ed76 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:31.858488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a47d180f-9613-48ea-85a2-e9f00d36ed76 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.164198 Jun 16 14:58:31.859064 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 102/226] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:31 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:32.017971 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f88efe61-8ce8-4e46-9a5f-1132c95fdfc8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:32.019110 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f88efe61-8ce8-4e46-9a5f-1132c95fdfc8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:32.029893 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f88efe61-8ce8-4e46-9a5f-1132c95fdfc8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:32.030640 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f88efe61-8ce8-4e46-9a5f-1132c95fdfc8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:32.031958 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f88efe61-8ce8-4e46-9a5f-1132c95fdfc8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:32.032675 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f88efe61-8ce8-4e46-9a5f-1132c95fdfc8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:32.096147 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c7af8177-5c4d-4487-a476-06c2e375f522 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:32.096867 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c7af8177-5c4d-4487-a476-06c2e375f522 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:32.103944 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c7af8177-5c4d-4487-a476-06c2e375f522 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:32.104394 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c7af8177-5c4d-4487-a476-06c2e375f522 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:32.105269 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c7af8177-5c4d-4487-a476-06c2e375f522 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:32.105714 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c7af8177-5c4d-4487-a476-06c2e375f522 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:32.194866 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f88efe61-8ce8-4e46-9a5f-1132c95fdfc8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:32.204635 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f88efe61-8ce8-4e46-9a5f-1132c95fdfc8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:32.206750 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f88efe61-8ce8-4e46-9a5f-1132c95fdfc8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:32.207973 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f88efe61-8ce8-4e46-9a5f-1132c95fdfc8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.196349 Jun 16 14:58:32.209107 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 125/227] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:32 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:32.225883 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d03976a6-3a59-4058-891b-bb87ba3c44b5 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:32.226900 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d03976a6-3a59-4058-891b-bb87ba3c44b5 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:32.234046 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d03976a6-3a59-4058-891b-bb87ba3c44b5 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:32.234495 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d03976a6-3a59-4058-891b-bb87ba3c44b5 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:32.235278 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d03976a6-3a59-4058-891b-bb87ba3c44b5 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:32.235715 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d03976a6-3a59-4058-891b-bb87ba3c44b5 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:32.261689 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c7af8177-5c4d-4487-a476-06c2e375f522 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:32.274673 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c7af8177-5c4d-4487-a476-06c2e375f522 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.182996 Jun 16 14:58:32.275628 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 103/228] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:32 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:32.381065 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d03976a6-3a59-4058-891b-bb87ba3c44b5 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:32.394064 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d03976a6-3a59-4058-891b-bb87ba3c44b5 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.171692 Jun 16 14:58:32.394881 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 126/229] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:32 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:32.876974 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b154d6c6-15c8-437c-b056-038971dc38f3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:32.877666 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b154d6c6-15c8-437c-b056-038971dc38f3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:32.884558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b154d6c6-15c8-437c-b056-038971dc38f3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:32.885053 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b154d6c6-15c8-437c-b056-038971dc38f3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:32.885815 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b154d6c6-15c8-437c-b056-038971dc38f3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:32.886251 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b154d6c6-15c8-437c-b056-038971dc38f3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:33.186156 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b154d6c6-15c8-437c-b056-038971dc38f3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:33.197035 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b154d6c6-15c8-437c-b056-038971dc38f3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.324523 Jun 16 14:58:33.197643 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 104/230] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:32 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:33.228228 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3a26e286-1ecf-47cf-baa9-4f58b1b46cbd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:33.228932 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3a26e286-1ecf-47cf-baa9-4f58b1b46cbd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:33.235504 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3a26e286-1ecf-47cf-baa9-4f58b1b46cbd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:33.236710 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3a26e286-1ecf-47cf-baa9-4f58b1b46cbd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:33.237568 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3a26e286-1ecf-47cf-baa9-4f58b1b46cbd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:33.238182 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3a26e286-1ecf-47cf-baa9-4f58b1b46cbd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:33.296388 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-841f27fb-1b03-4614-909d-d8431d072e4d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:33.297348 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-841f27fb-1b03-4614-909d-d8431d072e4d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:33.304055 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-841f27fb-1b03-4614-909d-d8431d072e4d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:33.304513 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-841f27fb-1b03-4614-909d-d8431d072e4d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:33.305950 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-841f27fb-1b03-4614-909d-d8431d072e4d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:33.307118 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-841f27fb-1b03-4614-909d-d8431d072e4d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:33.410911 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3a26e286-1ecf-47cf-baa9-4f58b1b46cbd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:33.417025 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:33.426593 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3a26e286-1ecf-47cf-baa9-4f58b1b46cbd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:33.428634 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3a26e286-1ecf-47cf-baa9-4f58b1b46cbd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:33.429804 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3a26e286-1ecf-47cf-baa9-4f58b1b46cbd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.206033 Jun 16 14:58:33.430432 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 127/231] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:33 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:33.437383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-66629ba6-38f8-414f-911f-eb84f7090597 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:33.438744 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-66629ba6-38f8-414f-911f-eb84f7090597 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:33.449555 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-66629ba6-38f8-414f-911f-eb84f7090597 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:33.450100 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-66629ba6-38f8-414f-911f-eb84f7090597 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:33.451108 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-66629ba6-38f8-414f-911f-eb84f7090597 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:33.451544 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-66629ba6-38f8-414f-911f-eb84f7090597 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:33.478371 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-841f27fb-1b03-4614-909d-d8431d072e4d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:33.491713 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-841f27fb-1b03-4614-909d-d8431d072e4d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.202447 Jun 16 14:58:33.492867 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 105/232] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:33 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:33.634686 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-66629ba6-38f8-414f-911f-eb84f7090597 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:33.643273 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-66629ba6-38f8-414f-911f-eb84f7090597 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.211520 Jun 16 14:58:33.643938 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 128/233] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:33 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:34.217078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e788e49c-4d1f-41a4-88f1-db38476e4d74 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:34.217709 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e788e49c-4d1f-41a4-88f1-db38476e4d74 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:34.226532 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e788e49c-4d1f-41a4-88f1-db38476e4d74 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:34.229449 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e788e49c-4d1f-41a4-88f1-db38476e4d74 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:34.231913 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e788e49c-4d1f-41a4-88f1-db38476e4d74 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:34.232612 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e788e49c-4d1f-41a4-88f1-db38476e4d74 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:34.246316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-3a64be13-87bc-47b6-88bd-05cc4ac722ec req-41b70348-4f35-4836-a845-92f51c0bd69e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "129cdf3c-4878-4058-9cb3-a2d36be40174", "name": "network-vif-plugged", "status": "completed", "tag": "dc9a5426-4d1e-4bfb-b195-628a512c0bf9"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:34.272876 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-3a64be13-87bc-47b6-88bd-05cc4ac722ec req-41b70348-4f35-4836-a845-92f51c0bd69e service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:34.276985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-3a64be13-87bc-47b6-88bd-05cc4ac722ec req-41b70348-4f35-4836-a845-92f51c0bd69e service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:34.363780 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-3a64be13-87bc-47b6-88bd-05cc4ac722ec req-41b70348-4f35-4836-a845-92f51c0bd69e service nova] Creating event network-vif-plugged:dc9a5426-4d1e-4bfb-b195-628a512c0bf9 for instance 129cdf3c-4878-4058-9cb3-a2d36be40174 on hv-cinder-83716 Jun 16 14:58:34.375050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-3a64be13-87bc-47b6-88bd-05cc4ac722ec req-41b70348-4f35-4836-a845-92f51c0bd69e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133097 Jun 16 14:58:34.379203 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 129/234] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 14:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:58:34.454574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-049e7cf6-8c91-4348-b2f3-ec09ca4c8bea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:34.456453 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-049e7cf6-8c91-4348-b2f3-ec09ca4c8bea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:34.470968 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-049e7cf6-8c91-4348-b2f3-ec09ca4c8bea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:34.474278 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-049e7cf6-8c91-4348-b2f3-ec09ca4c8bea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:34.476158 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-049e7cf6-8c91-4348-b2f3-ec09ca4c8bea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:34.477314 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-049e7cf6-8c91-4348-b2f3-ec09ca4c8bea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:34.499962 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e788e49c-4d1f-41a4-88f1-db38476e4d74 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:34.517693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e788e49c-4d1f-41a4-88f1-db38476e4d74 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.303738 Jun 16 14:58:34.518606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 106/235] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:34 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:34.532541 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c6fabdf3-8802-43a3-93b8-2ea90c575e52 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:34.537213 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c6fabdf3-8802-43a3-93b8-2ea90c575e52 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:34.546723 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c6fabdf3-8802-43a3-93b8-2ea90c575e52 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:34.547178 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c6fabdf3-8802-43a3-93b8-2ea90c575e52 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:34.548010 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c6fabdf3-8802-43a3-93b8-2ea90c575e52 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:34.548421 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c6fabdf3-8802-43a3-93b8-2ea90c575e52 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:34.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c6fabdf3-8802-43a3-93b8-2ea90c575e52 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:34.745042 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c6fabdf3-8802-43a3-93b8-2ea90c575e52 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.224490 Jun 16 14:58:34.745831 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 107/236] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:34 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:34.754717 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-efea407a-6aec-4f42-88ee-7c24df304343 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:34.754717 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-efea407a-6aec-4f42-88ee-7c24df304343 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:34.758231 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-efea407a-6aec-4f42-88ee-7c24df304343 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:34.758830 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-efea407a-6aec-4f42-88ee-7c24df304343 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:34.759641 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-efea407a-6aec-4f42-88ee-7c24df304343 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:34.760177 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-efea407a-6aec-4f42-88ee-7c24df304343 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:34.789116 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-049e7cf6-8c91-4348-b2f3-ec09ca4c8bea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:34.800611 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-049e7cf6-8c91-4348-b2f3-ec09ca4c8bea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:34.802859 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-049e7cf6-8c91-4348-b2f3-ec09ca4c8bea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:34.804638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-049e7cf6-8c91-4348-b2f3-ec09ca4c8bea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.357637 Jun 16 14:58:34.816611 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 130/237] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:34 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:34.935058 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-efea407a-6aec-4f42-88ee-7c24df304343 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:34.943984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-efea407a-6aec-4f42-88ee-7c24df304343 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.196979 Jun 16 14:58:34.944585 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 108/238] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:34 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:35.540157 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-11e035c2-e423-484f-8807-582d428e0134 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:35.541354 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-11e035c2-e423-484f-8807-582d428e0134 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:35.548308 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-11e035c2-e423-484f-8807-582d428e0134 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:35.548627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-11e035c2-e423-484f-8807-582d428e0134 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:35.549421 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-11e035c2-e423-484f-8807-582d428e0134 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:35.549867 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-11e035c2-e423-484f-8807-582d428e0134 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:35.744152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-11e035c2-e423-484f-8807-582d428e0134 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:35.752827 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-11e035c2-e423-484f-8807-582d428e0134 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.219698 Jun 16 14:58:35.754107 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 131/239] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:35 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:35.763367 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f647954c-f7d6-433f-a34e-5d2b82ae38a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:35.764069 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f647954c-f7d6-433f-a34e-5d2b82ae38a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:35.770928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f647954c-f7d6-433f-a34e-5d2b82ae38a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:35.771383 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f647954c-f7d6-433f-a34e-5d2b82ae38a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:35.772197 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f647954c-f7d6-433f-a34e-5d2b82ae38a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:35.772636 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f647954c-f7d6-433f-a34e-5d2b82ae38a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:35.846109 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a7087c04-c44b-4986-acee-5400f44e9f9f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:35.858072 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a7087c04-c44b-4986-acee-5400f44e9f9f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:35.867316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7087c04-c44b-4986-acee-5400f44e9f9f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:35.867975 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7087c04-c44b-4986-acee-5400f44e9f9f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:35.869382 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7087c04-c44b-4986-acee-5400f44e9f9f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:35.869604 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7087c04-c44b-4986-acee-5400f44e9f9f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:36.011930 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f647954c-f7d6-433f-a34e-5d2b82ae38a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:36.019273 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f647954c-f7d6-433f-a34e-5d2b82ae38a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.259870 Jun 16 14:58:36.019887 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 109/240] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:35 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:36.025173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3ac65914-b265-4bbb-a353-fdd54389df9d tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:36.025817 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3ac65914-b265-4bbb-a353-fdd54389df9d tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:36.033260 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ac65914-b265-4bbb-a353-fdd54389df9d tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:36.033710 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ac65914-b265-4bbb-a353-fdd54389df9d tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:36.034519 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ac65914-b265-4bbb-a353-fdd54389df9d tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:36.034956 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ac65914-b265-4bbb-a353-fdd54389df9d tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:36.098780 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a7087c04-c44b-4986-acee-5400f44e9f9f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:36.116396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a7087c04-c44b-4986-acee-5400f44e9f9f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:36.119132 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a7087c04-c44b-4986-acee-5400f44e9f9f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:36.120426 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a7087c04-c44b-4986-acee-5400f44e9f9f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.301158 Jun 16 14:58:36.131262 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 132/241] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:35 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:36.257044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3ac65914-b265-4bbb-a353-fdd54389df9d tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:36.265253 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3ac65914-b265-4bbb-a353-fdd54389df9d tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.244293 Jun 16 14:58:36.265837 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 110/242] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:36 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:36.770984 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9a73cf08-6e0c-4107-ba61-36443c78d77d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:36.771628 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9a73cf08-6e0c-4107-ba61-36443c78d77d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:36.779873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a73cf08-6e0c-4107-ba61-36443c78d77d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:36.780321 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a73cf08-6e0c-4107-ba61-36443c78d77d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:36.781139 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a73cf08-6e0c-4107-ba61-36443c78d77d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:36.781650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a73cf08-6e0c-4107-ba61-36443c78d77d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:36.942042 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9a73cf08-6e0c-4107-ba61-36443c78d77d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:36.965071 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9a73cf08-6e0c-4107-ba61-36443c78d77d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.196661 Jun 16 14:58:36.969198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 133/243] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:36 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:37.039287 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-67922bbd-a358-4155-8e64-d5587aabf0e9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:37.040608 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-67922bbd-a358-4155-8e64-d5587aabf0e9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:37.048711 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67922bbd-a358-4155-8e64-d5587aabf0e9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:37.049281 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67922bbd-a358-4155-8e64-d5587aabf0e9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:37.050259 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67922bbd-a358-4155-8e64-d5587aabf0e9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:37.050743 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67922bbd-a358-4155-8e64-d5587aabf0e9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:37.141694 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-836d7d0c-264f-426e-bad3-c9fd18f1b81e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:37.142342 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-836d7d0c-264f-426e-bad3-c9fd18f1b81e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:37.149071 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-836d7d0c-264f-426e-bad3-c9fd18f1b81e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:37.149529 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-836d7d0c-264f-426e-bad3-c9fd18f1b81e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:37.150536 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-836d7d0c-264f-426e-bad3-c9fd18f1b81e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:37.151077 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-836d7d0c-264f-426e-bad3-c9fd18f1b81e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:37.243382 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-67922bbd-a358-4155-8e64-d5587aabf0e9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:37.247124 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:37.254139 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-67922bbd-a358-4155-8e64-d5587aabf0e9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.218703 Jun 16 14:58:37.255336 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 111/244] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:37 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:37.284398 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-523a2912-8a87-4c0d-842e-3fc7beade370 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:37.285485 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-523a2912-8a87-4c0d-842e-3fc7beade370 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:37.297327 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-523a2912-8a87-4c0d-842e-3fc7beade370 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:37.297810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-523a2912-8a87-4c0d-842e-3fc7beade370 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:37.299383 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-523a2912-8a87-4c0d-842e-3fc7beade370 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:37.301803 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-523a2912-8a87-4c0d-842e-3fc7beade370 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:37.329291 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-836d7d0c-264f-426e-bad3-c9fd18f1b81e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:37.339110 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-836d7d0c-264f-426e-bad3-c9fd18f1b81e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:37.341215 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-836d7d0c-264f-426e-bad3-c9fd18f1b81e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:37.342603 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-836d7d0c-264f-426e-bad3-c9fd18f1b81e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.205829 Jun 16 14:58:37.343384 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 134/245] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:37 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 14:58:37.471089 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-523a2912-8a87-4c0d-842e-3fc7beade370 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:37.481740 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-523a2912-8a87-4c0d-842e-3fc7beade370 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.203604 Jun 16 14:58:37.482326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 112/246] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:37 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:37.981938 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fe8bbf50-2d60-447e-b537-2d5dd5ab1e80 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:37.982641 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fe8bbf50-2d60-447e-b537-2d5dd5ab1e80 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:37.989075 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fe8bbf50-2d60-447e-b537-2d5dd5ab1e80 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:37.989532 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fe8bbf50-2d60-447e-b537-2d5dd5ab1e80 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:37.990414 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fe8bbf50-2d60-447e-b537-2d5dd5ab1e80 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:37.990821 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fe8bbf50-2d60-447e-b537-2d5dd5ab1e80 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:38.136541 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fe8bbf50-2d60-447e-b537-2d5dd5ab1e80 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:38.145119 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fe8bbf50-2d60-447e-b537-2d5dd5ab1e80 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.166966 Jun 16 14:58:38.145980 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 135/247] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:37 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:38.283029 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-eb3dad58-7614-470e-a491-da8de717d004 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:38.283667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-eb3dad58-7614-470e-a491-da8de717d004 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:38.290053 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eb3dad58-7614-470e-a491-da8de717d004 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:38.290525 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eb3dad58-7614-470e-a491-da8de717d004 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:38.291305 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eb3dad58-7614-470e-a491-da8de717d004 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:38.291734 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eb3dad58-7614-470e-a491-da8de717d004 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:38.370862 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7d2a9af8-b0fd-4680-bfa0-f1bbf8ccdcac tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:38.371364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7d2a9af8-b0fd-4680-bfa0-f1bbf8ccdcac tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:38.379019 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7d2a9af8-b0fd-4680-bfa0-f1bbf8ccdcac tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:38.379477 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7d2a9af8-b0fd-4680-bfa0-f1bbf8ccdcac tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:38.380264 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7d2a9af8-b0fd-4680-bfa0-f1bbf8ccdcac tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:38.380702 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7d2a9af8-b0fd-4680-bfa0-f1bbf8ccdcac tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:38.454952 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-eb3dad58-7614-470e-a491-da8de717d004 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:38.463552 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-eb3dad58-7614-470e-a491-da8de717d004 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.184271 Jun 16 14:58:38.464397 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 113/248] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:38 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:38.501406 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-01f14dea-40a3-48c4-bbf7-05363992da29 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:38.502448 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-01f14dea-40a3-48c4-bbf7-05363992da29 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:38.512612 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-01f14dea-40a3-48c4-bbf7-05363992da29 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:38.513401 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-01f14dea-40a3-48c4-bbf7-05363992da29 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:38.514685 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-01f14dea-40a3-48c4-bbf7-05363992da29 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:38.515396 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-01f14dea-40a3-48c4-bbf7-05363992da29 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:38.530051 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7d2a9af8-b0fd-4680-bfa0-f1bbf8ccdcac tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:38.538716 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7d2a9af8-b0fd-4680-bfa0-f1bbf8ccdcac tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:38.541007 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7d2a9af8-b0fd-4680-bfa0-f1bbf8ccdcac tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:38.542199 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7d2a9af8-b0fd-4680-bfa0-f1bbf8ccdcac tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.176156 Jun 16 14:58:38.542850 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 136/249] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:38 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:58:38.670970 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-01f14dea-40a3-48c4-bbf7-05363992da29 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:38.682549 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-01f14dea-40a3-48c4-bbf7-05363992da29 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.186810 Jun 16 14:58:38.683346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 114/250] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:38 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:39.162259 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-210d097d-033c-4e2b-81bb-46f6a07e1509 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:39.162841 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-210d097d-033c-4e2b-81bb-46f6a07e1509 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:39.169902 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-210d097d-033c-4e2b-81bb-46f6a07e1509 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:39.170274 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-210d097d-033c-4e2b-81bb-46f6a07e1509 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:39.171020 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-210d097d-033c-4e2b-81bb-46f6a07e1509 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:39.171489 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-210d097d-033c-4e2b-81bb-46f6a07e1509 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:39.313776 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-210d097d-033c-4e2b-81bb-46f6a07e1509 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:39.321695 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-210d097d-033c-4e2b-81bb-46f6a07e1509 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.163245 Jun 16 14:58:39.322277 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 137/251] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:39 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:39.489629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-edc9b5ca-85bf-4cb9-9454-c95d6b1a0769 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:39.490400 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-edc9b5ca-85bf-4cb9-9454-c95d6b1a0769 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:39.500047 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-edc9b5ca-85bf-4cb9-9454-c95d6b1a0769 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:39.500633 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-edc9b5ca-85bf-4cb9-9454-c95d6b1a0769 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:39.501443 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-edc9b5ca-85bf-4cb9-9454-c95d6b1a0769 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:39.501882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-edc9b5ca-85bf-4cb9-9454-c95d6b1a0769 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:39.561157 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-429455ea-921c-4563-8d29-ae9f48f26457 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:39.561758 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-429455ea-921c-4563-8d29-ae9f48f26457 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:39.567893 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-429455ea-921c-4563-8d29-ae9f48f26457 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:39.568333 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-429455ea-921c-4563-8d29-ae9f48f26457 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:39.569283 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-429455ea-921c-4563-8d29-ae9f48f26457 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:39.569716 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-429455ea-921c-4563-8d29-ae9f48f26457 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:39.647516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-edc9b5ca-85bf-4cb9-9454-c95d6b1a0769 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:39.660378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-edc9b5ca-85bf-4cb9-9454-c95d6b1a0769 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.170686 Jun 16 14:58:39.660378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 115/252] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:39 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:39.704920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-478f0483-79b7-43b4-b3f8-308696cd552c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:39.705547 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-478f0483-79b7-43b4-b3f8-308696cd552c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:39.712417 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-478f0483-79b7-43b4-b3f8-308696cd552c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:39.712901 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-478f0483-79b7-43b4-b3f8-308696cd552c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:39.713700 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-478f0483-79b7-43b4-b3f8-308696cd552c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:39.714139 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-478f0483-79b7-43b4-b3f8-308696cd552c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:39.718292 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-429455ea-921c-4563-8d29-ae9f48f26457 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:39.734374 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-429455ea-921c-4563-8d29-ae9f48f26457 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:39.736328 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-429455ea-921c-4563-8d29-ae9f48f26457 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:39.737517 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-429455ea-921c-4563-8d29-ae9f48f26457 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.180217 Jun 16 14:58:39.738083 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 138/253] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:39 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:58:39.866860 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-478f0483-79b7-43b4-b3f8-308696cd552c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:39.875245 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-478f0483-79b7-43b4-b3f8-308696cd552c tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.174200 Jun 16 14:58:39.886510 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 116/254] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:39 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:40.341184 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-130fb48c-a883-4d0c-8a9e-98474748f741 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:40.342183 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-130fb48c-a883-4d0c-8a9e-98474748f741 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:40.348710 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-130fb48c-a883-4d0c-8a9e-98474748f741 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:40.349198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-130fb48c-a883-4d0c-8a9e-98474748f741 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:40.349962 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-130fb48c-a883-4d0c-8a9e-98474748f741 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:40.350389 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-130fb48c-a883-4d0c-8a9e-98474748f741 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:40.491782 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-130fb48c-a883-4d0c-8a9e-98474748f741 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:40.501079 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-130fb48c-a883-4d0c-8a9e-98474748f741 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.165987 Jun 16 14:58:40.501676 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 139/255] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:40 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:40.674346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-95b3038a-0432-439d-946f-8e940c684d34 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:40.674927 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-95b3038a-0432-439d-946f-8e940c684d34 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:40.683251 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95b3038a-0432-439d-946f-8e940c684d34 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:40.687043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95b3038a-0432-439d-946f-8e940c684d34 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:40.687043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95b3038a-0432-439d-946f-8e940c684d34 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:40.687043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95b3038a-0432-439d-946f-8e940c684d34 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:40.755683 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-63de672e-2c6a-4052-b5d3-5fb100b2776d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:40.756418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-63de672e-2c6a-4052-b5d3-5fb100b2776d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:40.763575 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-63de672e-2c6a-4052-b5d3-5fb100b2776d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:40.763939 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-63de672e-2c6a-4052-b5d3-5fb100b2776d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:40.764710 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-63de672e-2c6a-4052-b5d3-5fb100b2776d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:40.765203 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-63de672e-2c6a-4052-b5d3-5fb100b2776d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:40.836967 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-95b3038a-0432-439d-946f-8e940c684d34 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:40.845038 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-95b3038a-0432-439d-946f-8e940c684d34 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.174573 Jun 16 14:58:40.845616 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 117/256] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:40 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:40.894345 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-556f684b-7153-43bf-83b9-dc468ea130c2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:40.894959 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-556f684b-7153-43bf-83b9-dc468ea130c2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:40.903807 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-556f684b-7153-43bf-83b9-dc468ea130c2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:40.904588 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-556f684b-7153-43bf-83b9-dc468ea130c2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:40.906020 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-556f684b-7153-43bf-83b9-dc468ea130c2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:40.906630 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-556f684b-7153-43bf-83b9-dc468ea130c2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:40.912805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-63de672e-2c6a-4052-b5d3-5fb100b2776d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:40.920983 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-63de672e-2c6a-4052-b5d3-5fb100b2776d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:40.922479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-63de672e-2c6a-4052-b5d3-5fb100b2776d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:40.923597 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-63de672e-2c6a-4052-b5d3-5fb100b2776d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1407 microversion: 2.20 time: 0.172089 Jun 16 14:58:40.924160 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 140/257] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:40 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:58:41.051853 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-556f684b-7153-43bf-83b9-dc468ea130c2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:41.060175 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-556f684b-7153-43bf-83b9-dc468ea130c2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.169788 Jun 16 14:58:41.060760 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 118/258] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:40 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:41.518346 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9f46990e-aec0-43f6-9377-ebed15ed7083 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:41.518935 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9f46990e-aec0-43f6-9377-ebed15ed7083 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:41.525141 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9f46990e-aec0-43f6-9377-ebed15ed7083 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:41.525591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9f46990e-aec0-43f6-9377-ebed15ed7083 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:41.526667 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9f46990e-aec0-43f6-9377-ebed15ed7083 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:41.526790 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9f46990e-aec0-43f6-9377-ebed15ed7083 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:41.677340 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9f46990e-aec0-43f6-9377-ebed15ed7083 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:41.690232 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9f46990e-aec0-43f6-9377-ebed15ed7083 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.175604 Jun 16 14:58:41.690822 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 141/259] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:41 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:41.862886 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-61d57658-b97f-479e-bb08-fcb5818b8d2b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:41.863565 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-61d57658-b97f-479e-bb08-fcb5818b8d2b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:41.872207 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-61d57658-b97f-479e-bb08-fcb5818b8d2b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:41.873186 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-61d57658-b97f-479e-bb08-fcb5818b8d2b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:41.874189 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-61d57658-b97f-479e-bb08-fcb5818b8d2b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:41.874809 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-61d57658-b97f-479e-bb08-fcb5818b8d2b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:41.942430 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e5b18d08-a972-4637-93ee-07563d5d46db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:41.943252 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e5b18d08-a972-4637-93ee-07563d5d46db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:41.950610 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e5b18d08-a972-4637-93ee-07563d5d46db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:41.951318 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e5b18d08-a972-4637-93ee-07563d5d46db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:41.952285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e5b18d08-a972-4637-93ee-07563d5d46db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:41.952905 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e5b18d08-a972-4637-93ee-07563d5d46db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:42.052465 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-61d57658-b97f-479e-bb08-fcb5818b8d2b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:42.060689 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-61d57658-b97f-479e-bb08-fcb5818b8d2b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.202526 Jun 16 14:58:42.061299 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 119/260] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:41 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:42.091943 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-28fd90fb-568c-4bce-b2a2-68fc38573f92 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:42.092690 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-28fd90fb-568c-4bce-b2a2-68fc38573f92 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:42.100884 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-28fd90fb-568c-4bce-b2a2-68fc38573f92 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:42.102330 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-28fd90fb-568c-4bce-b2a2-68fc38573f92 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:42.104254 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-28fd90fb-568c-4bce-b2a2-68fc38573f92 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:42.105254 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-28fd90fb-568c-4bce-b2a2-68fc38573f92 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:42.116073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e5b18d08-a972-4637-93ee-07563d5d46db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:42.135509 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e5b18d08-a972-4637-93ee-07563d5d46db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:42.139204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e5b18d08-a972-4637-93ee-07563d5d46db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:42.139204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e5b18d08-a972-4637-93ee-07563d5d46db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1599 microversion: 2.20 time: 0.201142 Jun 16 14:58:42.139970 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 142/261] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 14:58:41 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1599 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 14:58:42.161894 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fb7349d6-3f83-4380-aab9-6945e83123ff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:42.162698 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fb7349d6-3f83-4380-aab9-6945e83123ff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:42.171521 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:42.175174 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fb7349d6-3f83-4380-aab9-6945e83123ff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:42.175892 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fb7349d6-3f83-4380-aab9-6945e83123ff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:42.177164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fb7349d6-3f83-4380-aab9-6945e83123ff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:42.178398 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fb7349d6-3f83-4380-aab9-6945e83123ff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:42.328993 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-28fd90fb-568c-4bce-b2a2-68fc38573f92 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:42.342466 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-28fd90fb-568c-4bce-b2a2-68fc38573f92 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.266045 Jun 16 14:58:42.343729 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 120/262] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:42 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:42.367417 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fb7349d6-3f83-4380-aab9-6945e83123ff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.211990 Jun 16 14:58:42.376370 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 143/263] 10.222.0.72 () {60 vars in 1315 bytes} [Thu Jun 16 14:58:42 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/os-interface => generated 285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 14:58:42.717880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b3abc3c4-9db3-4f3d-83b6-76139e684b92 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:42.719071 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b3abc3c4-9db3-4f3d-83b6-76139e684b92 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:42.733745 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3abc3c4-9db3-4f3d-83b6-76139e684b92 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:42.737643 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3abc3c4-9db3-4f3d-83b6-76139e684b92 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:42.739234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3abc3c4-9db3-4f3d-83b6-76139e684b92 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:42.751288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3abc3c4-9db3-4f3d-83b6-76139e684b92 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:42.953442 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b3abc3c4-9db3-4f3d-83b6-76139e684b92 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:42.962418 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b3abc3c4-9db3-4f3d-83b6-76139e684b92 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.251052 Jun 16 14:58:42.972125 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 121/264] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:42 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:43.080408 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-75e12769-1ebd-4fa5-9f20-ec154184a5bd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:43.083291 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-75e12769-1ebd-4fa5-9f20-ec154184a5bd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:43.091862 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75e12769-1ebd-4fa5-9f20-ec154184a5bd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:43.092322 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75e12769-1ebd-4fa5-9f20-ec154184a5bd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:43.093134 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75e12769-1ebd-4fa5-9f20-ec154184a5bd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:43.093582 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75e12769-1ebd-4fa5-9f20-ec154184a5bd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:43.371293 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-25d44480-6219-4d88-af60-8877cb758927 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:43.372829 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-25d44480-6219-4d88-af60-8877cb758927 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:43.380540 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-25d44480-6219-4d88-af60-8877cb758927 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:43.381531 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-25d44480-6219-4d88-af60-8877cb758927 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:43.382932 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-25d44480-6219-4d88-af60-8877cb758927 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:43.384017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-25d44480-6219-4d88-af60-8877cb758927 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:43.652082 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-75e12769-1ebd-4fa5-9f20-ec154184a5bd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:43.689595 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-75e12769-1ebd-4fa5-9f20-ec154184a5bd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.599223 Jun 16 14:58:43.707568 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 144/265] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:43 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:43.856655 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-25d44480-6219-4d88-af60-8877cb758927 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:43.874816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-25d44480-6219-4d88-af60-8877cb758927 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.510422 Jun 16 14:58:43.892361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 122/266] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:43 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:43.989133 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7ffad8cf-8d2b-449a-9e8d-daa051b20e38 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:43.990241 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7ffad8cf-8d2b-449a-9e8d-daa051b20e38 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:44.006508 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ffad8cf-8d2b-449a-9e8d-daa051b20e38 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:44.011876 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ffad8cf-8d2b-449a-9e8d-daa051b20e38 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:44.014116 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ffad8cf-8d2b-449a-9e8d-daa051b20e38 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:44.019835 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ffad8cf-8d2b-449a-9e8d-daa051b20e38 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:44.087060 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-2b14caab-0df8-427e-bbe8-60971c340e05 req-506a29b2-b552-464f-a9e9-b430954dbba9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd17881d-ac5f-44ca-a709-a52350a37a18", "name": "network-vif-plugged", "status": "completed", "tag": "644ccac5-3aa8-48a4-a0e4-484eabb05969"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:44.106240 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:44.114886 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-2b14caab-0df8-427e-bbe8-60971c340e05 req-506a29b2-b552-464f-a9e9-b430954dbba9 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:44.115515 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-2b14caab-0df8-427e-bbe8-60971c340e05 req-506a29b2-b552-464f-a9e9-b430954dbba9 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:44.134781 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-2b14caab-0df8-427e-bbe8-60971c340e05 req-506a29b2-b552-464f-a9e9-b430954dbba9 service nova] Creating event network-vif-plugged:644ccac5-3aa8-48a4-a0e4-484eabb05969 for instance fd17881d-ac5f-44ca-a709-a52350a37a18 on hv-cinder-83716 Jun 16 14:58:44.142905 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-2b14caab-0df8-427e-bbe8-60971c340e05 req-506a29b2-b552-464f-a9e9-b430954dbba9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079959 Jun 16 14:58:44.143736 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 123/267] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 14:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:58:44.345664 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7ffad8cf-8d2b-449a-9e8d-daa051b20e38 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:44.357612 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7ffad8cf-8d2b-449a-9e8d-daa051b20e38 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.381557 Jun 16 14:58:44.359454 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 145/268] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:43 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:44.473156 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-a2330758-8461-4ede-bd43-5f0f5c70a8b9 req-f6415c0d-a784-4a94-834b-450aa737492f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9", "tag": "4a15d94a-43cc-45b4-89d5-3b8cdc6c8c65"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:44.491209 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-a2330758-8461-4ede-bd43-5f0f5c70a8b9 req-f6415c0d-a784-4a94-834b-450aa737492f service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:44.492207 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-a2330758-8461-4ede-bd43-5f0f5c70a8b9 req-f6415c0d-a784-4a94-834b-450aa737492f service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:44.515367 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-a2330758-8461-4ede-bd43-5f0f5c70a8b9 req-f6415c0d-a784-4a94-834b-450aa737492f service nova] Creating event network-changed:4a15d94a-43cc-45b4-89d5-3b8cdc6c8c65 for instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 on hv-cinder-83716 Jun 16 14:58:44.522062 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-a2330758-8461-4ede-bd43-5f0f5c70a8b9 req-f6415c0d-a784-4a94-834b-450aa737492f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055175 Jun 16 14:58:44.523036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 124/269] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 14:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:58:44.719358 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4d124e76-8142-42a1-89a7-9ea8f03219b4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:44.720441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4d124e76-8142-42a1-89a7-9ea8f03219b4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:44.755670 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4d124e76-8142-42a1-89a7-9ea8f03219b4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:44.756488 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4d124e76-8142-42a1-89a7-9ea8f03219b4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:44.757917 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4d124e76-8142-42a1-89a7-9ea8f03219b4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:44.758753 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4d124e76-8142-42a1-89a7-9ea8f03219b4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:44.908183 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e8164904-4216-425b-a514-cf36328a48c2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:44.912830 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e8164904-4216-425b-a514-cf36328a48c2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:44.923279 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e8164904-4216-425b-a514-cf36328a48c2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:44.924067 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e8164904-4216-425b-a514-cf36328a48c2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:44.925687 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e8164904-4216-425b-a514-cf36328a48c2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:44.926683 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e8164904-4216-425b-a514-cf36328a48c2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:44.997186 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4d124e76-8142-42a1-89a7-9ea8f03219b4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:45.006406 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4d124e76-8142-42a1-89a7-9ea8f03219b4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.294508 Jun 16 14:58:45.007371 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 146/270] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:44 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:45.193490 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e8164904-4216-425b-a514-cf36328a48c2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:45.234515 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e8164904-4216-425b-a514-cf36328a48c2 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.336671 Jun 16 14:58:45.243200 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 125/271] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:44 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:45.381412 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-59c7ef01-7d33-41e7-a6bd-661466f8d50f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:45.382160 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-59c7ef01-7d33-41e7-a6bd-661466f8d50f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:45.391853 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-59c7ef01-7d33-41e7-a6bd-661466f8d50f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:45.392806 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-59c7ef01-7d33-41e7-a6bd-661466f8d50f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:45.394581 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-59c7ef01-7d33-41e7-a6bd-661466f8d50f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:45.395218 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-59c7ef01-7d33-41e7-a6bd-661466f8d50f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:45.563825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-59c7ef01-7d33-41e7-a6bd-661466f8d50f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:45.573070 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-59c7ef01-7d33-41e7-a6bd-661466f8d50f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.200329 Jun 16 14:58:45.573648 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 147/272] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:45 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:46.023753 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ea4e12fa-5558-47b9-8eff-920e06a01add tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:46.024372 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ea4e12fa-5558-47b9-8eff-920e06a01add tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:46.031035 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ea4e12fa-5558-47b9-8eff-920e06a01add tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:46.031494 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ea4e12fa-5558-47b9-8eff-920e06a01add tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:46.032280 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ea4e12fa-5558-47b9-8eff-920e06a01add tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:46.032725 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ea4e12fa-5558-47b9-8eff-920e06a01add tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:46.198928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ea4e12fa-5558-47b9-8eff-920e06a01add tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:46.211940 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ea4e12fa-5558-47b9-8eff-920e06a01add tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.191285 Jun 16 14:58:46.212493 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 126/273] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:46 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:46.260997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5d6f6366-e6d1-4fcf-a2c7-d02d43a30957 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:46.261673 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5d6f6366-e6d1-4fcf-a2c7-d02d43a30957 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:46.267943 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d6f6366-e6d1-4fcf-a2c7-d02d43a30957 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:46.268402 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d6f6366-e6d1-4fcf-a2c7-d02d43a30957 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:46.269211 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d6f6366-e6d1-4fcf-a2c7-d02d43a30957 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:46.269650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d6f6366-e6d1-4fcf-a2c7-d02d43a30957 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:46.433275 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5d6f6366-e6d1-4fcf-a2c7-d02d43a30957 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:46.441019 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5d6f6366-e6d1-4fcf-a2c7-d02d43a30957 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.184875 Jun 16 14:58:46.441514 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 148/274] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:46 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:46.591426 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-04860eb5-2fe5-4799-8f2c-4f7993f1dc55 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:46.592191 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-04860eb5-2fe5-4799-8f2c-4f7993f1dc55 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:46.599670 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-04860eb5-2fe5-4799-8f2c-4f7993f1dc55 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:46.599956 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-04860eb5-2fe5-4799-8f2c-4f7993f1dc55 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:46.600738 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-04860eb5-2fe5-4799-8f2c-4f7993f1dc55 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:46.601214 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-04860eb5-2fe5-4799-8f2c-4f7993f1dc55 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:46.761584 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-04860eb5-2fe5-4799-8f2c-4f7993f1dc55 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:46.773755 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-04860eb5-2fe5-4799-8f2c-4f7993f1dc55 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.187092 Jun 16 14:58:46.774374 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 127/275] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:46 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:47.232313 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7f8cfab3-8c11-48a1-a227-7a21bcb174b5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:47.232613 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7f8cfab3-8c11-48a1-a227-7a21bcb174b5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:47.244518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7f8cfab3-8c11-48a1-a227-7a21bcb174b5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:47.245451 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7f8cfab3-8c11-48a1-a227-7a21bcb174b5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:47.246400 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7f8cfab3-8c11-48a1-a227-7a21bcb174b5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:47.246842 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7f8cfab3-8c11-48a1-a227-7a21bcb174b5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:47.422803 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7f8cfab3-8c11-48a1-a227-7a21bcb174b5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:47.431245 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7f8cfab3-8c11-48a1-a227-7a21bcb174b5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.204354 Jun 16 14:58:47.432931 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 149/276] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:47 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:47.461084 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-222aaaf3-14a6-4447-bb97-852905f31124 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:47.462902 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-222aaaf3-14a6-4447-bb97-852905f31124 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:47.474002 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=98 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:47.481986 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-222aaaf3-14a6-4447-bb97-852905f31124 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:47.481986 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-222aaaf3-14a6-4447-bb97-852905f31124 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:47.481986 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-222aaaf3-14a6-4447-bb97-852905f31124 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:47.481986 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-222aaaf3-14a6-4447-bb97-852905f31124 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:47.630786 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-222aaaf3-14a6-4447-bb97-852905f31124 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:47.640526 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-222aaaf3-14a6-4447-bb97-852905f31124 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.184722 Jun 16 14:58:47.650043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 128/277] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:47 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:47.794264 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-33573525-295d-46d4-89d6-700edb3ee614 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:47.794871 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-33573525-295d-46d4-89d6-700edb3ee614 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:47.801365 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-33573525-295d-46d4-89d6-700edb3ee614 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:47.801713 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-33573525-295d-46d4-89d6-700edb3ee614 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:47.802488 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-33573525-295d-46d4-89d6-700edb3ee614 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:47.802929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-33573525-295d-46d4-89d6-700edb3ee614 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:47.969654 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-33573525-295d-46d4-89d6-700edb3ee614 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:47.977970 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-33573525-295d-46d4-89d6-700edb3ee614 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.187377 Jun 16 14:58:47.978554 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 150/278] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:47 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:48.451041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fb3dbf43-72ff-415b-bd03-cd3d3be045f6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:48.451746 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fb3dbf43-72ff-415b-bd03-cd3d3be045f6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:48.458093 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb3dbf43-72ff-415b-bd03-cd3d3be045f6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:48.458545 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb3dbf43-72ff-415b-bd03-cd3d3be045f6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:48.459441 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb3dbf43-72ff-415b-bd03-cd3d3be045f6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:48.460200 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb3dbf43-72ff-415b-bd03-cd3d3be045f6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:48.629847 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-fb3dbf43-72ff-415b-bd03-cd3d3be045f6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:48.634640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:48.639968 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fb3dbf43-72ff-415b-bd03-cd3d3be045f6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.193315 Jun 16 14:58:48.641045 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 129/279] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:48 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:48.674823 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-55c24114-82f0-4fce-ba1e-cb6b6549f257 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:48.676246 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-55c24114-82f0-4fce-ba1e-cb6b6549f257 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:48.683984 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-55c24114-82f0-4fce-ba1e-cb6b6549f257 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:48.684615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-55c24114-82f0-4fce-ba1e-cb6b6549f257 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:48.685415 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-55c24114-82f0-4fce-ba1e-cb6b6549f257 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:48.685848 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-55c24114-82f0-4fce-ba1e-cb6b6549f257 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:48.880960 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-55c24114-82f0-4fce-ba1e-cb6b6549f257 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:48.889675 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-55c24114-82f0-4fce-ba1e-cb6b6549f257 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.220958 Jun 16 14:58:48.890431 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 151/280] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:48 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:48.999556 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d2407b4d-755c-4266-bd43-98b7d32971f6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:49.000186 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d2407b4d-755c-4266-bd43-98b7d32971f6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:49.006613 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2407b4d-755c-4266-bd43-98b7d32971f6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:49.007072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2407b4d-755c-4266-bd43-98b7d32971f6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:49.007848 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2407b4d-755c-4266-bd43-98b7d32971f6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:49.008296 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2407b4d-755c-4266-bd43-98b7d32971f6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:49.155942 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d2407b4d-755c-4266-bd43-98b7d32971f6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:49.169829 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d2407b4d-755c-4266-bd43-98b7d32971f6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1322 microversion: 2.1 time: 0.174702 Jun 16 14:58:49.170840 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 130/281] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:48 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:49.669636 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-785f6838-64ad-40b0-92d0-47e5358372c8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:49.670250 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-785f6838-64ad-40b0-92d0-47e5358372c8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:49.677340 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-785f6838-64ad-40b0-92d0-47e5358372c8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:49.677888 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-785f6838-64ad-40b0-92d0-47e5358372c8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:49.678714 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-785f6838-64ad-40b0-92d0-47e5358372c8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:49.679101 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-785f6838-64ad-40b0-92d0-47e5358372c8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:49.853204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-785f6838-64ad-40b0-92d0-47e5358372c8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:49.864881 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-785f6838-64ad-40b0-92d0-47e5358372c8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.200775 Jun 16 14:58:49.867699 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 152/282] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:49 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:49.909364 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d484e10c-ec00-40eb-9c80-7ea3ebe82a61 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:49.910425 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d484e10c-ec00-40eb-9c80-7ea3ebe82a61 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:49.917907 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d484e10c-ec00-40eb-9c80-7ea3ebe82a61 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:49.918501 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d484e10c-ec00-40eb-9c80-7ea3ebe82a61 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:49.919532 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d484e10c-ec00-40eb-9c80-7ea3ebe82a61 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:49.920226 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d484e10c-ec00-40eb-9c80-7ea3ebe82a61 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:50.109996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d484e10c-ec00-40eb-9c80-7ea3ebe82a61 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:50.119717 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d484e10c-ec00-40eb-9c80-7ea3ebe82a61 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1314 microversion: 2.1 time: 0.215740 Jun 16 14:58:50.120298 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 131/283] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:49 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:50.192162 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-dbee709c-cbb7-4afe-b26f-d9aff73b6b1c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:50.192797 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-dbee709c-cbb7-4afe-b26f-d9aff73b6b1c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:50.199746 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dbee709c-cbb7-4afe-b26f-d9aff73b6b1c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:50.200191 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dbee709c-cbb7-4afe-b26f-d9aff73b6b1c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:50.200994 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dbee709c-cbb7-4afe-b26f-d9aff73b6b1c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:50.201434 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dbee709c-cbb7-4afe-b26f-d9aff73b6b1c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:50.339626 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-dbee709c-cbb7-4afe-b26f-d9aff73b6b1c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:50.348097 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-dbee709c-cbb7-4afe-b26f-d9aff73b6b1c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1516 microversion: 2.1 time: 0.160020 Jun 16 14:58:50.348663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 153/284] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:50 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:50.366290 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ea0dee0b-4ab4-477f-88d2-e15a45db4ff2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:50.367369 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ea0dee0b-4ab4-477f-88d2-e15a45db4ff2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:50.373835 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ea0dee0b-4ab4-477f-88d2-e15a45db4ff2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:50.374277 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ea0dee0b-4ab4-477f-88d2-e15a45db4ff2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:50.375037 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ea0dee0b-4ab4-477f-88d2-e15a45db4ff2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:50.375473 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ea0dee0b-4ab4-477f-88d2-e15a45db4ff2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:50.447868 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-ea0dee0b-4ab4-477f-88d2-e15a45db4ff2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lazy-loading 'flavor' on Instance uuid 129cdf3c-4878-4058-9cb3-a2d36be40174 {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:58:50.583913 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ea0dee0b-4ab4-477f-88d2-e15a45db4ff2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "POST /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174/action" status: 200 len: 32 microversion: 2.1 time: 0.221437 Jun 16 14:58:50.584430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 132/285] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Jun 16 14:58:50 2022] POST /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174/action => generated 32 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 14:58:50.593934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c9ae81b7-5d21-46d9-b0f7-323e7b449bdf tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:50.594541 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c9ae81b7-5d21-46d9-b0f7-323e7b449bdf tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:50.600949 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c9ae81b7-5d21-46d9-b0f7-323e7b449bdf tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:50.601405 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c9ae81b7-5d21-46d9-b0f7-323e7b449bdf tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:50.602255 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c9ae81b7-5d21-46d9-b0f7-323e7b449bdf tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:50.602693 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c9ae81b7-5d21-46d9-b0f7-323e7b449bdf tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:50.747668 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c9ae81b7-5d21-46d9-b0f7-323e7b449bdf tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:50.755730 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c9ae81b7-5d21-46d9-b0f7-323e7b449bdf tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.165526 Jun 16 14:58:50.756390 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 154/286] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:50 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:50.893690 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-10af12f0-ec1e-40ef-adf4-ff77534b47ac tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:50.894643 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-10af12f0-ec1e-40ef-adf4-ff77534b47ac tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:50.907261 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-10af12f0-ec1e-40ef-adf4-ff77534b47ac tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:50.907719 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-10af12f0-ec1e-40ef-adf4-ff77534b47ac tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:50.908829 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-10af12f0-ec1e-40ef-adf4-ff77534b47ac tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:50.910629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-10af12f0-ec1e-40ef-adf4-ff77534b47ac tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:50.966041 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-48e03b12-78a7-413e-a2dd-6217f82a14b1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1473697872", "imageRef": "23371504-a4d6-4064-90b4-87bfd0a15170", "flavorRef": "452"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:51.102958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-10af12f0-ec1e-40ef-adf4-ff77534b47ac tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:51.111453 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-10af12f0-ec1e-40ef-adf4-ff77534b47ac tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.226126 Jun 16 14:58:51.112054 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 133/287] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:50 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:51.137295 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-40846794-7cb8-464d-8ea5-5276f196ea12 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:51.137941 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-40846794-7cb8-464d-8ea5-5276f196ea12 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:51.144574 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-40846794-7cb8-464d-8ea5-5276f196ea12 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:51.145298 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-40846794-7cb8-464d-8ea5-5276f196ea12 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:51.150271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-40846794-7cb8-464d-8ea5-5276f196ea12 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:51.150271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-40846794-7cb8-464d-8ea5-5276f196ea12 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:51.392054 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-40846794-7cb8-464d-8ea5-5276f196ea12 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:51.401199 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-40846794-7cb8-464d-8ea5-5276f196ea12 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1500 microversion: 2.1 time: 0.268456 Jun 16 14:58:51.401893 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 134/288] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:51 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1500 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:51.783484 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f3ad77db-35a1-4e28-a498-a13c6316a463 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:51.783484 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f3ad77db-35a1-4e28-a498-a13c6316a463 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:51.783484 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f3ad77db-35a1-4e28-a498-a13c6316a463 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:51.783484 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f3ad77db-35a1-4e28-a498-a13c6316a463 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:51.783999 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f3ad77db-35a1-4e28-a498-a13c6316a463 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:51.784504 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f3ad77db-35a1-4e28-a498-a13c6316a463 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:52.064412 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f3ad77db-35a1-4e28-a498-a13c6316a463 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:52.073341 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f3ad77db-35a1-4e28-a498-a13c6316a463 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.302753 Jun 16 14:58:52.073918 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 135/289] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:51 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:52.131136 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0693b73d-83e6-4a9a-bc15-a28bddf5aae8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:52.131743 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0693b73d-83e6-4a9a-bc15-a28bddf5aae8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:52.137909 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0693b73d-83e6-4a9a-bc15-a28bddf5aae8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:52.138358 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0693b73d-83e6-4a9a-bc15-a28bddf5aae8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:52.139122 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0693b73d-83e6-4a9a-bc15-a28bddf5aae8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:52.139561 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0693b73d-83e6-4a9a-bc15-a28bddf5aae8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:52.532548 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0693b73d-83e6-4a9a-bc15-a28bddf5aae8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:52.544625 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0693b73d-83e6-4a9a-bc15-a28bddf5aae8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.416895 Jun 16 14:58:52.556186 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 136/290] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:52 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:52.556186 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-bc859949-cbf3-407e-b9b9-d3f9fc21cc9a req-56d163f5-ca41-4d18-b049-13b5b7690727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133e2287-518a-4c4e-bb51-8790ed7647a7", "name": "network-vif-plugged", "status": "completed", "tag": "ea6268ec-2917-4b9f-ac8d-bc4237b637d9"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:52.578249 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-bc859949-cbf3-407e-b9b9-d3f9fc21cc9a req-56d163f5-ca41-4d18-b049-13b5b7690727 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:52.578531 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-bc859949-cbf3-407e-b9b9-d3f9fc21cc9a req-56d163f5-ca41-4d18-b049-13b5b7690727 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:52.596140 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-bc859949-cbf3-407e-b9b9-d3f9fc21cc9a req-56d163f5-ca41-4d18-b049-13b5b7690727 service nova] Creating event network-vif-plugged:ea6268ec-2917-4b9f-ac8d-bc4237b637d9 for instance 133e2287-518a-4c4e-bb51-8790ed7647a7 on hv-cinder-83716 Jun 16 14:58:52.604084 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-bc859949-cbf3-407e-b9b9-d3f9fc21cc9a req-56d163f5-ca41-4d18-b049-13b5b7690727 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055868 Jun 16 14:58:52.605259 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 137/291] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 14:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:58:53.091862 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-eddfce34-91ee-452c-89e0-0b61700e7776 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:53.092942 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-eddfce34-91ee-452c-89e0-0b61700e7776 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:53.099044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eddfce34-91ee-452c-89e0-0b61700e7776 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:53.099614 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eddfce34-91ee-452c-89e0-0b61700e7776 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:53.100450 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eddfce34-91ee-452c-89e0-0b61700e7776 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:53.101125 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eddfce34-91ee-452c-89e0-0b61700e7776 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:53.268713 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-eddfce34-91ee-452c-89e0-0b61700e7776 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:53.277672 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-eddfce34-91ee-452c-89e0-0b61700e7776 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.189988 Jun 16 14:58:53.278247 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 138/292] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:53 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:53.563857 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c677035c-a7d3-401f-814c-2908c0826ad7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:53.564458 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c677035c-a7d3-401f-814c-2908c0826ad7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:53.571386 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c677035c-a7d3-401f-814c-2908c0826ad7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:53.571839 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c677035c-a7d3-401f-814c-2908c0826ad7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:53.572614 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c677035c-a7d3-401f-814c-2908c0826ad7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:53.573082 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c677035c-a7d3-401f-814c-2908c0826ad7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:53.714588 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c677035c-a7d3-401f-814c-2908c0826ad7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:53.722421 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c677035c-a7d3-401f-814c-2908c0826ad7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.162407 Jun 16 14:58:53.723068 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 139/293] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:53 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:53.933429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d11e1d2a-fd98-4ba0-8b5c-2f4670922e6f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce2806e1-a5c1-4b4b-bb4d-f6afa8e2e525"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:53.934673 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d11e1d2a-fd98-4ba0-8b5c-2f4670922e6f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:53.942298 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d11e1d2a-fd98-4ba0-8b5c-2f4670922e6f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:53.942634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d11e1d2a-fd98-4ba0-8b5c-2f4670922e6f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:53.943412 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d11e1d2a-fd98-4ba0-8b5c-2f4670922e6f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:53.943861 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d11e1d2a-fd98-4ba0-8b5c-2f4670922e6f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:54.754864 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d11e1d2a-fd98-4ba0-8b5c-2f4670922e6f tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "POST /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.827001 Jun 16 14:58:54.755660 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 140/294] 10.222.0.72 () {60 vars in 1322 bytes} [Thu Jun 16 14:58:53 2022] POST /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18/os-volume_attachments => generated 194 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:58:54.762678 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-691c1541-897b-4ff5-8927-f9679a10bfb9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:54.764053 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-691c1541-897b-4ff5-8927-f9679a10bfb9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:54.773116 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-691c1541-897b-4ff5-8927-f9679a10bfb9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:54.774200 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-691c1541-897b-4ff5-8927-f9679a10bfb9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:54.775068 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-691c1541-897b-4ff5-8927-f9679a10bfb9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:54.775554 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-691c1541-897b-4ff5-8927-f9679a10bfb9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:54.975100 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-691c1541-897b-4ff5-8927-f9679a10bfb9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:54.984583 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-691c1541-897b-4ff5-8927-f9679a10bfb9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.227647 Jun 16 14:58:54.985281 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 141/295] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:54 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:54.994249 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2a98fe9d-3435-4e38-a416-94478c7e571d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:54.995409 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2a98fe9d-3435-4e38-a416-94478c7e571d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:55.005414 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a98fe9d-3435-4e38-a416-94478c7e571d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:55.006152 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a98fe9d-3435-4e38-a416-94478c7e571d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:55.006948 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a98fe9d-3435-4e38-a416-94478c7e571d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:55.007392 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a98fe9d-3435-4e38-a416-94478c7e571d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:55.205482 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2a98fe9d-3435-4e38-a416-94478c7e571d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:55.214584 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2a98fe9d-3435-4e38-a416-94478c7e571d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1367 microversion: 2.1 time: 0.227728 Jun 16 14:58:55.215157 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 142/296] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:54 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:56.014597 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-edeae995-e46a-4f29-8b7c-4a1f664df076 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:56.015421 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-edeae995-e46a-4f29-8b7c-4a1f664df076 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:56.022246 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-edeae995-e46a-4f29-8b7c-4a1f664df076 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:56.022707 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-edeae995-e46a-4f29-8b7c-4a1f664df076 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:56.024233 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-edeae995-e46a-4f29-8b7c-4a1f664df076 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:56.024642 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-edeae995-e46a-4f29-8b7c-4a1f664df076 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:56.196703 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-edeae995-e46a-4f29-8b7c-4a1f664df076 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:56.201423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:58:56.210499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-edeae995-e46a-4f29-8b7c-4a1f664df076 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.196377 Jun 16 14:58:56.211704 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 143/297] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:56 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:56.233446 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-677aa83b-b920-43c1-bab1-e4bd6dac770e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:56.234424 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-677aa83b-b920-43c1-bab1-e4bd6dac770e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:56.244869 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-677aa83b-b920-43c1-bab1-e4bd6dac770e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:56.246449 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-677aa83b-b920-43c1-bab1-e4bd6dac770e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:56.247757 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-677aa83b-b920-43c1-bab1-e4bd6dac770e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:56.248506 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-677aa83b-b920-43c1-bab1-e4bd6dac770e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:56.427651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-677aa83b-b920-43c1-bab1-e4bd6dac770e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:56.432393 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-677aa83b-b920-43c1-bab1-e4bd6dac770e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1558 microversion: 2.1 time: 0.202711 Jun 16 14:58:56.433100 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 144/298] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:56 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1558 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:58:56.451453 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-63f75969-2365-4d8c-a85d-7db5a4cb6b0c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:56.451453 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-63f75969-2365-4d8c-a85d-7db5a4cb6b0c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:56.458084 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63f75969-2365-4d8c-a85d-7db5a4cb6b0c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:56.458543 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63f75969-2365-4d8c-a85d-7db5a4cb6b0c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:56.459333 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63f75969-2365-4d8c-a85d-7db5a4cb6b0c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:56.459778 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63f75969-2365-4d8c-a85d-7db5a4cb6b0c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:56.546482 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-63f75969-2365-4d8c-a85d-7db5a4cb6b0c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099324 Jun 16 14:58:56.547012 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 145/299] 10.222.0.72 () {58 vars in 1274 bytes} [Thu Jun 16 14:58:56 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:58:57.228396 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5acc10b1-40b6-4bc4-ba78-d72fad06328b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:57.229048 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5acc10b1-40b6-4bc4-ba78-d72fad06328b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:57.236399 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5acc10b1-40b6-4bc4-ba78-d72fad06328b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:57.236855 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5acc10b1-40b6-4bc4-ba78-d72fad06328b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:57.237685 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5acc10b1-40b6-4bc4-ba78-d72fad06328b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:57.238123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5acc10b1-40b6-4bc4-ba78-d72fad06328b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:57.729008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5acc10b1-40b6-4bc4-ba78-d72fad06328b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:57.737008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5acc10b1-40b6-4bc4-ba78-d72fad06328b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.513219 Jun 16 14:58:57.738242 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 146/300] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:57 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:58:58.188040 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-9081a778-62cc-44cb-8750-765cee6ed852 req-3827baf3-fc98-4c07-a10e-7cc0376df83b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "133e2287-518a-4c4e-bb51-8790ed7647a7", "tag": "ea6268ec-2917-4b9f-ac8d-bc4237b637d9"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:58:58.201935 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-9081a778-62cc-44cb-8750-765cee6ed852 req-3827baf3-fc98-4c07-a10e-7cc0376df83b service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:58.202383 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-9081a778-62cc-44cb-8750-765cee6ed852 req-3827baf3-fc98-4c07-a10e-7cc0376df83b service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:58.215957 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-9081a778-62cc-44cb-8750-765cee6ed852 req-3827baf3-fc98-4c07-a10e-7cc0376df83b service nova] Creating event network-changed:ea6268ec-2917-4b9f-ac8d-bc4237b637d9 for instance 133e2287-518a-4c4e-bb51-8790ed7647a7 on hv-cinder-83716 Jun 16 14:58:58.223710 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-9081a778-62cc-44cb-8750-765cee6ed852 req-3827baf3-fc98-4c07-a10e-7cc0376df83b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039476 Jun 16 14:58:58.224499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 147/301] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 14:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:58:58.758767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-58a1cfd9-c35b-42c5-a8b1-10ea1b6326b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:58:58.760241 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-58a1cfd9-c35b-42c5-a8b1-10ea1b6326b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:58:58.766863 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-58a1cfd9-c35b-42c5-a8b1-10ea1b6326b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:58.767354 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-58a1cfd9-c35b-42c5-a8b1-10ea1b6326b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:58.768166 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-58a1cfd9-c35b-42c5-a8b1-10ea1b6326b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:58:58.768609 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-58a1cfd9-c35b-42c5-a8b1-10ea1b6326b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:58:58.993923 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-58a1cfd9-c35b-42c5-a8b1-10ea1b6326b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:58:59.014627 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-58a1cfd9-c35b-42c5-a8b1-10ea1b6326b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.262178 Jun 16 14:58:59.025966 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 148/302] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:58:58 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:00.049550 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5665bb3c-cd9b-4c4f-ac5f-4db45f16ce0e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:00.050475 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5665bb3c-cd9b-4c4f-ac5f-4db45f16ce0e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:00.057857 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5665bb3c-cd9b-4c4f-ac5f-4db45f16ce0e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:00.058319 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5665bb3c-cd9b-4c4f-ac5f-4db45f16ce0e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:00.059099 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5665bb3c-cd9b-4c4f-ac5f-4db45f16ce0e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:00.059547 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5665bb3c-cd9b-4c4f-ac5f-4db45f16ce0e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:00.233509 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5665bb3c-cd9b-4c4f-ac5f-4db45f16ce0e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:00.241867 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5665bb3c-cd9b-4c4f-ac5f-4db45f16ce0e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.196078 Jun 16 14:59:00.243071 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 149/303] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:00 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:00.752007 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=56 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:00.977761 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=25 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:01.260097 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6dd0fae9-3558-48bc-8ba9-4218530d6011 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:01.260712 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6dd0fae9-3558-48bc-8ba9-4218530d6011 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:01.269575 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6dd0fae9-3558-48bc-8ba9-4218530d6011 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:01.270070 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6dd0fae9-3558-48bc-8ba9-4218530d6011 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:01.270835 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6dd0fae9-3558-48bc-8ba9-4218530d6011 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:01.271382 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6dd0fae9-3558-48bc-8ba9-4218530d6011 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:01.459878 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6dd0fae9-3558-48bc-8ba9-4218530d6011 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:01.468579 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6dd0fae9-3558-48bc-8ba9-4218530d6011 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.212793 Jun 16 14:59:01.469210 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 150/304] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:01 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:02.487486 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0580496a-d8ad-4d14-a0a0-6cd4b42ab980 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:02.488567 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0580496a-d8ad-4d14-a0a0-6cd4b42ab980 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:02.497970 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0580496a-d8ad-4d14-a0a0-6cd4b42ab980 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:02.498486 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0580496a-d8ad-4d14-a0a0-6cd4b42ab980 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:02.499775 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0580496a-d8ad-4d14-a0a0-6cd4b42ab980 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:02.500484 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0580496a-d8ad-4d14-a0a0-6cd4b42ab980 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:02.640746 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0580496a-d8ad-4d14-a0a0-6cd4b42ab980 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:02.650080 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0580496a-d8ad-4d14-a0a0-6cd4b42ab980 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.166615 Jun 16 14:59:02.655610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 151/305] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:02 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:03.199877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.network.neutron [None req-48e03b12-78a7-413e-a2dd-6217f82a14b1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] validate_networks() for None {{(pid=124589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:59:03.551266 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-48e03b12-78a7-413e-a2dd-6217f82a14b1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Flavor limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:59:03.551965 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-48e03b12-78a7-413e-a2dd-6217f82a14b1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Image limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:59:03.552748 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-48e03b12-78a7-413e-a2dd-6217f82a14b1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Flavor pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:59:03.553480 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-48e03b12-78a7-413e-a2dd-6217f82a14b1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Image pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:59:03.554194 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-48e03b12-78a7-413e-a2dd-6217f82a14b1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:59:03.571802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-48e03b12-78a7-413e-a2dd-6217f82a14b1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:03.571802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-48e03b12-78a7-413e-a2dd-6217f82a14b1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:03.571802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-48e03b12-78a7-413e-a2dd-6217f82a14b1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:03.571802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-48e03b12-78a7-413e-a2dd-6217f82a14b1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:03.591301 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-48e03b12-78a7-413e-a2dd-6217f82a14b1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Getting quotas for project 22a75da564c3434ca8a1cff32b9edd4d. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:59:03.596270 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-48e03b12-78a7-413e-a2dd-6217f82a14b1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Getting quotas for user 0030bdbe0d0f466a97b37f4f5a83b02f and project 22a75da564c3434ca8a1cff32b9edd4d. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:59:03.608464 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-48e03b12-78a7-413e-a2dd-6217f82a14b1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Going to run 1 instances... {{(pid=124589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:59:03.611158 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-48e03b12-78a7-413e-a2dd-6217f82a14b1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23371504-a4d6-4064-90b4-87bfd0a15170',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:59:03.663529 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-48e03b12-78a7-413e-a2dd-6217f82a14b1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.704176 Jun 16 14:59:03.665125 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 155/306] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 14:58:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 12706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:59:03.669167 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f3c514de-e9ed-49b8-9460-b502aea31801 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:03.671117 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f3c514de-e9ed-49b8-9460-b502aea31801 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:03.676052 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c157cf5e-e400-4238-bc4c-0201361739ce tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:03.676567 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c157cf5e-e400-4238-bc4c-0201361739ce tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:03.680226 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f3c514de-e9ed-49b8-9460-b502aea31801 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:03.681124 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f3c514de-e9ed-49b8-9460-b502aea31801 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:03.682151 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f3c514de-e9ed-49b8-9460-b502aea31801 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:03.682885 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f3c514de-e9ed-49b8-9460-b502aea31801 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:03.742109 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c157cf5e-e400-4238-bc4c-0201361739ce tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:03.751600 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c157cf5e-e400-4238-bc4c-0201361739ce tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1215 microversion: 2.1 time: 0.079024 Jun 16 14:59:03.752596 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 156/307] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:03 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1215 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:04.048896 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f3c514de-e9ed-49b8-9460-b502aea31801 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:04.057722 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f3c514de-e9ed-49b8-9460-b502aea31801 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.393866 Jun 16 14:59:04.058407 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 152/308] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:03 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:04.773709 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-65b48e28-5a9d-4c4c-96f6-3a0494d328c8 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:04.774692 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-65b48e28-5a9d-4c4c-96f6-3a0494d328c8 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:04.782596 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-65b48e28-5a9d-4c4c-96f6-3a0494d328c8 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:04.783048 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-65b48e28-5a9d-4c4c-96f6-3a0494d328c8 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:04.783916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-65b48e28-5a9d-4c4c-96f6-3a0494d328c8 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:04.784585 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-65b48e28-5a9d-4c4c-96f6-3a0494d328c8 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:04.859914 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-65b48e28-5a9d-4c4c-96f6-3a0494d328c8 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:04.869542 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-65b48e28-5a9d-4c4c-96f6-3a0494d328c8 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1211 microversion: 2.1 time: 0.101198 Jun 16 14:59:04.870387 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 157/309] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:04 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:05.075925 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bc1fb8e4-d08a-4f2d-b83f-e223220bfc93 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:05.076703 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bc1fb8e4-d08a-4f2d-b83f-e223220bfc93 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:05.084831 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc1fb8e4-d08a-4f2d-b83f-e223220bfc93 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:05.085315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc1fb8e4-d08a-4f2d-b83f-e223220bfc93 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:05.086372 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc1fb8e4-d08a-4f2d-b83f-e223220bfc93 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:05.086811 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc1fb8e4-d08a-4f2d-b83f-e223220bfc93 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:05.239646 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bc1fb8e4-d08a-4f2d-b83f-e223220bfc93 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:05.248396 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bc1fb8e4-d08a-4f2d-b83f-e223220bfc93 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.176394 Jun 16 14:59:05.249045 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 153/310] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:05 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:05.616569 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b7ca151c-f77b-4d1b-88f5-61df3b89d982 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:05.617700 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b7ca151c-f77b-4d1b-88f5-61df3b89d982 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:05.624100 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b7ca151c-f77b-4d1b-88f5-61df3b89d982 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:05.624637 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b7ca151c-f77b-4d1b-88f5-61df3b89d982 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:05.626096 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b7ca151c-f77b-4d1b-88f5-61df3b89d982 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:05.626096 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b7ca151c-f77b-4d1b-88f5-61df3b89d982 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:05.660187 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b7ca151c-f77b-4d1b-88f5-61df3b89d982 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:59:05.771710 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b7ca151c-f77b-4d1b-88f5-61df3b89d982 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "DELETE /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 204 len: 0 microversion: 2.1 time: 0.158520 Jun 16 14:59:05.772388 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 158/311] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 14:59:05 2022] DELETE /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 14:59:05.789915 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6762646a-4c2c-45b3-b03a-fd7fba1726bc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:05.789915 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6762646a-4c2c-45b3-b03a-fd7fba1726bc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:05.795541 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6762646a-4c2c-45b3-b03a-fd7fba1726bc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:05.796076 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6762646a-4c2c-45b3-b03a-fd7fba1726bc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:05.797121 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6762646a-4c2c-45b3-b03a-fd7fba1726bc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:05.797602 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6762646a-4c2c-45b3-b03a-fd7fba1726bc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:05.899330 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d9d0118e-9e9e-4363-ac75-5186031c6fa7 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:05.900054 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d9d0118e-9e9e-4363-ac75-5186031c6fa7 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:05.909812 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d9d0118e-9e9e-4363-ac75-5186031c6fa7 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:05.910267 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d9d0118e-9e9e-4363-ac75-5186031c6fa7 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:05.911436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d9d0118e-9e9e-4363-ac75-5186031c6fa7 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:05.912008 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d9d0118e-9e9e-4363-ac75-5186031c6fa7 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:06.018309 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6762646a-4c2c-45b3-b03a-fd7fba1726bc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:06.031649 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6762646a-4c2c-45b3-b03a-fd7fba1726bc tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1552 microversion: 2.1 time: 0.252256 Jun 16 14:59:06.045060 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 154/312] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:05 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1552 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:06.055198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d9d0118e-9e9e-4363-ac75-5186031c6fa7 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:06.075607 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d9d0118e-9e9e-4363-ac75-5186031c6fa7 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1267 microversion: 2.1 time: 0.184341 Jun 16 14:59:06.076200 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 159/313] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:05 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:06.266770 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-55a7a998-8e67-44aa-bce0-217aa0bcdfeb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:06.267737 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-55a7a998-8e67-44aa-bce0-217aa0bcdfeb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:06.274368 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-55a7a998-8e67-44aa-bce0-217aa0bcdfeb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:06.274826 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-55a7a998-8e67-44aa-bce0-217aa0bcdfeb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:06.275621 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-55a7a998-8e67-44aa-bce0-217aa0bcdfeb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:06.276059 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-55a7a998-8e67-44aa-bce0-217aa0bcdfeb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:06.424001 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-55a7a998-8e67-44aa-bce0-217aa0bcdfeb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:06.433166 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-55a7a998-8e67-44aa-bce0-217aa0bcdfeb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.170053 Jun 16 14:59:06.433747 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 155/314] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:06 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:07.050229 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-eb5b4a3c-c859-42bf-bdd2-d38b240e3faa tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:07.050852 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-eb5b4a3c-c859-42bf-bdd2-d38b240e3faa tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:07.058785 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eb5b4a3c-c859-42bf-bdd2-d38b240e3faa tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:07.059291 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eb5b4a3c-c859-42bf-bdd2-d38b240e3faa tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:07.060719 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eb5b4a3c-c859-42bf-bdd2-d38b240e3faa tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:07.060719 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eb5b4a3c-c859-42bf-bdd2-d38b240e3faa tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:07.093452 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-77ef26a1-286b-4318-86a4-f2e168fdb337 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:07.094073 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-77ef26a1-286b-4318-86a4-f2e168fdb337 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:07.100667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-77ef26a1-286b-4318-86a4-f2e168fdb337 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:07.101139 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-77ef26a1-286b-4318-86a4-f2e168fdb337 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:07.102607 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-77ef26a1-286b-4318-86a4-f2e168fdb337 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:07.103238 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-77ef26a1-286b-4318-86a4-f2e168fdb337 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:07.169648 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-77ef26a1-286b-4318-86a4-f2e168fdb337 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:07.178286 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-77ef26a1-286b-4318-86a4-f2e168fdb337 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1275 microversion: 2.1 time: 0.088531 Jun 16 14:59:07.178943 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 156/315] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:07 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:07.233110 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-eb5b4a3c-c859-42bf-bdd2-d38b240e3faa tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:07.241573 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-eb5b4a3c-c859-42bf-bdd2-d38b240e3faa tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1552 microversion: 2.1 time: 0.195175 Jun 16 14:59:07.242856 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 160/316] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:07 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1552 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:07.455880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ff87709c-b1dd-4db3-8e3f-6568290e5cca tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:07.456430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ff87709c-b1dd-4db3-8e3f-6568290e5cca tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:07.463560 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ff87709c-b1dd-4db3-8e3f-6568290e5cca tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:07.464012 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ff87709c-b1dd-4db3-8e3f-6568290e5cca tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:07.464819 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ff87709c-b1dd-4db3-8e3f-6568290e5cca tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:07.465293 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ff87709c-b1dd-4db3-8e3f-6568290e5cca tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:07.604449 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ff87709c-b1dd-4db3-8e3f-6568290e5cca tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:07.612400 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ff87709c-b1dd-4db3-8e3f-6568290e5cca tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.160546 Jun 16 14:59:07.613009 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 157/317] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:07 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:08.197863 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e0cb7c38-0266-4c6c-b8bc-f85a4b3146bf tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:08.198506 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e0cb7c38-0266-4c6c-b8bc-f85a4b3146bf tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:08.204723 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e0cb7c38-0266-4c6c-b8bc-f85a4b3146bf tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:08.205203 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e0cb7c38-0266-4c6c-b8bc-f85a4b3146bf tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:08.205975 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e0cb7c38-0266-4c6c-b8bc-f85a4b3146bf tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:08.206402 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e0cb7c38-0266-4c6c-b8bc-f85a4b3146bf tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:08.261004 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0eeedde4-3c3c-499b-bc27-d78bda73acce tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:08.261606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0eeedde4-3c3c-499b-bc27-d78bda73acce tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:08.269117 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0eeedde4-3c3c-499b-bc27-d78bda73acce tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:08.269500 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0eeedde4-3c3c-499b-bc27-d78bda73acce tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:08.270307 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0eeedde4-3c3c-499b-bc27-d78bda73acce tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:08.270717 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0eeedde4-3c3c-499b-bc27-d78bda73acce tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:08.272153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e0cb7c38-0266-4c6c-b8bc-f85a4b3146bf tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:08.280155 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e0cb7c38-0266-4c6c-b8bc-f85a4b3146bf tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1275 microversion: 2.1 time: 0.087139 Jun 16 14:59:08.281429 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 161/318] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:08 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1275 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:08.585682 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0eeedde4-3c3c-499b-bc27-d78bda73acce tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:08.594502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0eeedde4-3c3c-499b-bc27-d78bda73acce tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1552 microversion: 2.1 time: 0.338624 Jun 16 14:59:08.595184 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 158/319] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:08 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1552 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:08.628662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-78328136-18d9-4237-b4b2-3823dbe4742b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:08.629421 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-78328136-18d9-4237-b4b2-3823dbe4742b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:08.636806 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-78328136-18d9-4237-b4b2-3823dbe4742b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:08.637804 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-78328136-18d9-4237-b4b2-3823dbe4742b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:08.637980 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-78328136-18d9-4237-b4b2-3823dbe4742b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:08.638409 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-78328136-18d9-4237-b4b2-3823dbe4742b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:08.789343 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-78328136-18d9-4237-b4b2-3823dbe4742b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:08.799309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-78328136-18d9-4237-b4b2-3823dbe4742b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.174332 Jun 16 14:59:08.799894 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 162/320] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:08 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:09.303096 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-aa91e524-b67e-474e-9cec-1e9aba544403 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:09.305551 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-aa91e524-b67e-474e-9cec-1e9aba544403 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:09.316304 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aa91e524-b67e-474e-9cec-1e9aba544403 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:09.317361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aa91e524-b67e-474e-9cec-1e9aba544403 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:09.318775 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aa91e524-b67e-474e-9cec-1e9aba544403 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:09.320498 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aa91e524-b67e-474e-9cec-1e9aba544403 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:09.411487 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-aa91e524-b67e-474e-9cec-1e9aba544403 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:09.422652 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-aa91e524-b67e-474e-9cec-1e9aba544403 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1273 microversion: 2.1 time: 0.126748 Jun 16 14:59:09.423486 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 159/321] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:09 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1273 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:09.616991 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-707fbf16-377d-457d-9c1f-a91295c06576 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:09.618575 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-707fbf16-377d-457d-9c1f-a91295c06576 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:09.625673 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-707fbf16-377d-457d-9c1f-a91295c06576 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:09.626099 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-707fbf16-377d-457d-9c1f-a91295c06576 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:09.627181 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-707fbf16-377d-457d-9c1f-a91295c06576 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:09.627615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-707fbf16-377d-457d-9c1f-a91295c06576 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:09.795138 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-707fbf16-377d-457d-9c1f-a91295c06576 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:09.814774 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-707fbf16-377d-457d-9c1f-a91295c06576 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1552 microversion: 2.1 time: 0.202594 Jun 16 14:59:09.815627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 163/322] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:09 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1552 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:09.817644 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-95b09a74-98f7-42b0-ba13-ee62b0d05622 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:09.818407 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-95b09a74-98f7-42b0-ba13-ee62b0d05622 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:09.830102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95b09a74-98f7-42b0-ba13-ee62b0d05622 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:09.830545 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95b09a74-98f7-42b0-ba13-ee62b0d05622 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:09.831320 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95b09a74-98f7-42b0-ba13-ee62b0d05622 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:09.831950 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95b09a74-98f7-42b0-ba13-ee62b0d05622 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:10.387233 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-95b09a74-98f7-42b0-ba13-ee62b0d05622 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:10.395517 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-95b09a74-98f7-42b0-ba13-ee62b0d05622 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.581931 Jun 16 14:59:10.396427 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 160/323] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:09 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:10.441328 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-248a6ef1-c185-46f4-8a22-f1af224d7145 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:10.441942 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-248a6ef1-c185-46f4-8a22-f1af224d7145 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:10.449088 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-248a6ef1-c185-46f4-8a22-f1af224d7145 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:10.449541 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-248a6ef1-c185-46f4-8a22-f1af224d7145 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:10.450325 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-248a6ef1-c185-46f4-8a22-f1af224d7145 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:10.450960 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-248a6ef1-c185-46f4-8a22-f1af224d7145 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:10.595958 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-248a6ef1-c185-46f4-8a22-f1af224d7145 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:10.604924 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-248a6ef1-c185-46f4-8a22-f1af224d7145 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1315 microversion: 2.1 time: 0.167590 Jun 16 14:59:10.605802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 164/324] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:10 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:10.837363 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-80b4eaba-a53f-4341-8153-bfdc76f8c5d6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:10.838987 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-80b4eaba-a53f-4341-8153-bfdc76f8c5d6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:10.846853 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80b4eaba-a53f-4341-8153-bfdc76f8c5d6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:10.847448 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80b4eaba-a53f-4341-8153-bfdc76f8c5d6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:10.848346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80b4eaba-a53f-4341-8153-bfdc76f8c5d6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:10.849052 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80b4eaba-a53f-4341-8153-bfdc76f8c5d6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:10.873069 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:11.367668 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-80b4eaba-a53f-4341-8153-bfdc76f8c5d6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:11.377456 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-80b4eaba-a53f-4341-8153-bfdc76f8c5d6 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1552 microversion: 2.1 time: 0.545384 Jun 16 14:59:11.378352 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 161/325] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:10 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1552 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:11.419871 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e967cc9e-05c2-41bc-83de-10b687b1fcbe tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:11.420533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e967cc9e-05c2-41bc-83de-10b687b1fcbe tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:11.428736 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e967cc9e-05c2-41bc-83de-10b687b1fcbe tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:11.429863 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e967cc9e-05c2-41bc-83de-10b687b1fcbe tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:11.430745 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e967cc9e-05c2-41bc-83de-10b687b1fcbe tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:11.431194 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e967cc9e-05c2-41bc-83de-10b687b1fcbe tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:11.626557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f5f18958-3604-403d-8722-c79540bf79f1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:11.627506 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f5f18958-3604-403d-8722-c79540bf79f1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:11.639246 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e967cc9e-05c2-41bc-83de-10b687b1fcbe tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:11.640510 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5f18958-3604-403d-8722-c79540bf79f1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:11.641164 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5f18958-3604-403d-8722-c79540bf79f1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:11.642100 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5f18958-3604-403d-8722-c79540bf79f1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:11.642686 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5f18958-3604-403d-8722-c79540bf79f1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:11.648634 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e967cc9e-05c2-41bc-83de-10b687b1fcbe tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.237733 Jun 16 14:59:11.651391 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 165/326] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:11 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:11.946858 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-c6a8248a-1e07-4b01-add8-f453b22abb63 req-08d18c9e-b75a-4867-b833-fd4a18bb9de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81ae5bb3-0883-4d56-8204-f83a030a3de2", "tag": "16a983ba-ff5a-4173-91d2-22e55f7dc337"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:11.957130 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-c6a8248a-1e07-4b01-add8-f453b22abb63 req-08d18c9e-b75a-4867-b833-fd4a18bb9de6 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:11.958038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-c6a8248a-1e07-4b01-add8-f453b22abb63 req-08d18c9e-b75a-4867-b833-fd4a18bb9de6 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:11.981811 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-c6a8248a-1e07-4b01-add8-f453b22abb63 req-08d18c9e-b75a-4867-b833-fd4a18bb9de6 service nova] Creating event network-changed:16a983ba-ff5a-4173-91d2-22e55f7dc337 for instance 81ae5bb3-0883-4d56-8204-f83a030a3de2 on hv-cinder-83716 Jun 16 14:59:11.989967 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-c6a8248a-1e07-4b01-add8-f453b22abb63 req-08d18c9e-b75a-4867-b833-fd4a18bb9de6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046990 Jun 16 14:59:11.990835 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 166/327] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 14:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:59:12.404757 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2871939f-4e1f-4374-93ab-dc3c5f179f1a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:12.405774 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2871939f-4e1f-4374-93ab-dc3c5f179f1a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:12.415351 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2871939f-4e1f-4374-93ab-dc3c5f179f1a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:12.415351 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2871939f-4e1f-4374-93ab-dc3c5f179f1a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:12.415987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2871939f-4e1f-4374-93ab-dc3c5f179f1a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:12.416755 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2871939f-4e1f-4374-93ab-dc3c5f179f1a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:12.455322 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f5f18958-3604-403d-8722-c79540bf79f1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:12.466724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f5f18958-3604-403d-8722-c79540bf79f1 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1315 microversion: 2.1 time: 0.847738 Jun 16 14:59:12.467996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 162/328] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:11 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1315 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:12.543740 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2871939f-4e1f-4374-93ab-dc3c5f179f1a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:12.554120 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2871939f-4e1f-4374-93ab-dc3c5f179f1a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1510 microversion: 2.1 time: 0.155900 Jun 16 14:59:12.555454 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 167/329] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:12 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:12.666864 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-57aacda1-6492-4bce-a732-2f486fef748b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:12.667486 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-57aacda1-6492-4bce-a732-2f486fef748b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:12.674104 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57aacda1-6492-4bce-a732-2f486fef748b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:12.674811 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57aacda1-6492-4bce-a732-2f486fef748b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:12.675593 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57aacda1-6492-4bce-a732-2f486fef748b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:12.676036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57aacda1-6492-4bce-a732-2f486fef748b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:12.850174 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-57aacda1-6492-4bce-a732-2f486fef748b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:12.861346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-57aacda1-6492-4bce-a732-2f486fef748b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.198278 Jun 16 14:59:12.861957 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 163/330] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:12 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:13.483764 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7ef4bd92-27fb-407b-95a6-c03297910cee tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:13.484096 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7ef4bd92-27fb-407b-95a6-c03297910cee tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:13.490549 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ef4bd92-27fb-407b-95a6-c03297910cee tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:13.490864 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ef4bd92-27fb-407b-95a6-c03297910cee tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:13.491653 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ef4bd92-27fb-407b-95a6-c03297910cee tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:13.492100 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ef4bd92-27fb-407b-95a6-c03297910cee tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:13.571828 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6a60a6f5-b813-4170-bada-cac7044b7702 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:13.572437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6a60a6f5-b813-4170-bada-cac7044b7702 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:13.578864 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6a60a6f5-b813-4170-bada-cac7044b7702 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:13.579326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6a60a6f5-b813-4170-bada-cac7044b7702 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:13.580275 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6a60a6f5-b813-4170-bada-cac7044b7702 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:13.580893 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6a60a6f5-b813-4170-bada-cac7044b7702 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:13.581031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:13.646842 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7ef4bd92-27fb-407b-95a6-c03297910cee tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:13.652781 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6a60a6f5-b813-4170-bada-cac7044b7702 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:13.656183 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7ef4bd92-27fb-407b-95a6-c03297910cee tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1315 microversion: 2.1 time: 0.176453 Jun 16 14:59:13.656947 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 168/331] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:13 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:13.661480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6a60a6f5-b813-4170-bada-cac7044b7702 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1345 microversion: 2.1 time: 0.093372 Jun 16 14:59:13.662286 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 164/332] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:13 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:13.880606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f613f369-3631-4587-8b02-344af98d732e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:13.881250 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f613f369-3631-4587-8b02-344af98d732e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:13.883679 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=8 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:13.889312 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f613f369-3631-4587-8b02-344af98d732e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:13.889760 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f613f369-3631-4587-8b02-344af98d732e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:13.890628 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f613f369-3631-4587-8b02-344af98d732e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:13.890965 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f613f369-3631-4587-8b02-344af98d732e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:14.026580 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-8fc608dd-6e98-4e51-9ee8-dd2f4a2709d9 req-28321baa-ace5-4a52-8662-67cdef037287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd17881d-ac5f-44ca-a709-a52350a37a18", "name": "network-vif-deleted", "tag": "644ccac5-3aa8-48a4-a0e4-484eabb05969"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:14.038002 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-8fc608dd-6e98-4e51-9ee8-dd2f4a2709d9 req-28321baa-ace5-4a52-8662-67cdef037287 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:14.038101 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f613f369-3631-4587-8b02-344af98d732e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:14.038196 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-8fc608dd-6e98-4e51-9ee8-dd2f4a2709d9 req-28321baa-ace5-4a52-8662-67cdef037287 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:14.045924 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f613f369-3631-4587-8b02-344af98d732e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.169218 Jun 16 14:59:14.054710 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 169/333] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:13 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:14.062281 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-8fc608dd-6e98-4e51-9ee8-dd2f4a2709d9 req-28321baa-ace5-4a52-8662-67cdef037287 service nova] Creating event network-vif-deleted:644ccac5-3aa8-48a4-a0e4-484eabb05969 for instance fd17881d-ac5f-44ca-a709-a52350a37a18 on hv-cinder-83716 Jun 16 14:59:14.073006 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-8fc608dd-6e98-4e51-9ee8-dd2f4a2709d9 req-28321baa-ace5-4a52-8662-67cdef037287 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049733 Jun 16 14:59:14.074174 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 165/334] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 14:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:59:14.676995 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f67c852f-fb41-47db-8865-28d891263474 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:14.677832 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f67c852f-fb41-47db-8865-28d891263474 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:14.683602 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ed733689-1537-4f60-8584-7d27f539826a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:14.684505 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ed733689-1537-4f60-8584-7d27f539826a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:14.686238 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f67c852f-fb41-47db-8865-28d891263474 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:14.686836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f67c852f-fb41-47db-8865-28d891263474 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:14.687892 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f67c852f-fb41-47db-8865-28d891263474 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:14.688484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f67c852f-fb41-47db-8865-28d891263474 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:14.693180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ed733689-1537-4f60-8584-7d27f539826a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:14.693638 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ed733689-1537-4f60-8584-7d27f539826a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:14.694431 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ed733689-1537-4f60-8584-7d27f539826a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:14.694926 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ed733689-1537-4f60-8584-7d27f539826a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:14.784878 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ed733689-1537-4f60-8584-7d27f539826a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:14.794067 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ed733689-1537-4f60-8584-7d27f539826a tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1345 microversion: 2.1 time: 0.117140 Jun 16 14:59:14.794748 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 166/335] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:14 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1345 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:14.853849 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f67c852f-fb41-47db-8865-28d891263474 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:14.871553 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f67c852f-fb41-47db-8865-28d891263474 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1315 microversion: 2.1 time: 0.200898 Jun 16 14:59:14.872095 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 170/336] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:14 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:15.064082 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-49bdbf77-3b68-4f1e-a7ec-5687923bc34a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:15.064695 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-49bdbf77-3b68-4f1e-a7ec-5687923bc34a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:15.072484 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-49bdbf77-3b68-4f1e-a7ec-5687923bc34a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:15.072977 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-49bdbf77-3b68-4f1e-a7ec-5687923bc34a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:15.074360 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-49bdbf77-3b68-4f1e-a7ec-5687923bc34a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:15.075392 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-49bdbf77-3b68-4f1e-a7ec-5687923bc34a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:15.225766 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-49bdbf77-3b68-4f1e-a7ec-5687923bc34a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:15.234710 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-49bdbf77-3b68-4f1e-a7ec-5687923bc34a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.174421 Jun 16 14:59:15.235287 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 167/337] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:15 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:15.813128 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8e8eec62-22ec-4ad4-b550-2ea0b64adb51 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:15.813959 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8e8eec62-22ec-4ad4-b550-2ea0b64adb51 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:15.822819 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8e8eec62-22ec-4ad4-b550-2ea0b64adb51 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:15.823221 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8e8eec62-22ec-4ad4-b550-2ea0b64adb51 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:15.823990 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8e8eec62-22ec-4ad4-b550-2ea0b64adb51 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:15.824415 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8e8eec62-22ec-4ad4-b550-2ea0b64adb51 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:15.892318 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-73f1365e-5236-49f5-a306-1685fce4621b tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:15.893085 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-73f1365e-5236-49f5-a306-1685fce4621b tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:15.901242 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-73f1365e-5236-49f5-a306-1685fce4621b tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:15.901849 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-73f1365e-5236-49f5-a306-1685fce4621b tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:15.903381 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-73f1365e-5236-49f5-a306-1685fce4621b tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:15.904107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-73f1365e-5236-49f5-a306-1685fce4621b tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:15.916402 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8e8eec62-22ec-4ad4-b550-2ea0b64adb51 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:15.926729 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8e8eec62-22ec-4ad4-b550-2ea0b64adb51 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1345 microversion: 2.1 time: 0.117260 Jun 16 14:59:15.933373 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 171/338] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:15 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1345 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:16.127274 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-73f1365e-5236-49f5-a306-1685fce4621b tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:16.135660 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-73f1365e-5236-49f5-a306-1685fce4621b tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1315 microversion: 2.1 time: 0.247806 Jun 16 14:59:16.136744 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 168/339] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:15 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:16.251587 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-bcee9fac-82d6-4278-91dc-c7c230a2504b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:16.252197 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-bcee9fac-82d6-4278-91dc-c7c230a2504b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:16.258629 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bcee9fac-82d6-4278-91dc-c7c230a2504b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:16.259079 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bcee9fac-82d6-4278-91dc-c7c230a2504b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:16.259856 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bcee9fac-82d6-4278-91dc-c7c230a2504b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:16.260292 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bcee9fac-82d6-4278-91dc-c7c230a2504b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:16.264561 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:16.425680 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bcee9fac-82d6-4278-91dc-c7c230a2504b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:16.436321 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-bcee9fac-82d6-4278-91dc-c7c230a2504b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.188533 Jun 16 14:59:16.436915 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 172/340] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:16 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:16.943666 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-03fcbdbe-2f9e-4e3b-b1fc-3d2b4ece67cd tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:16.944245 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-03fcbdbe-2f9e-4e3b-b1fc-3d2b4ece67cd tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:16.951259 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03fcbdbe-2f9e-4e3b-b1fc-3d2b4ece67cd tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:16.951972 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03fcbdbe-2f9e-4e3b-b1fc-3d2b4ece67cd tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:16.952867 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03fcbdbe-2f9e-4e3b-b1fc-3d2b4ece67cd tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:16.953387 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03fcbdbe-2f9e-4e3b-b1fc-3d2b4ece67cd tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:17.024350 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-03fcbdbe-2f9e-4e3b-b1fc-3d2b4ece67cd tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:17.033889 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-03fcbdbe-2f9e-4e3b-b1fc-3d2b4ece67cd tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1345 microversion: 2.1 time: 0.094083 Jun 16 14:59:17.034413 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 169/341] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:16 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:17.154723 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-982607fe-a6dc-4c46-9b5f-4b90b18a2417 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:17.156063 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-982607fe-a6dc-4c46-9b5f-4b90b18a2417 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:17.162757 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-982607fe-a6dc-4c46-9b5f-4b90b18a2417 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:17.163303 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-982607fe-a6dc-4c46-9b5f-4b90b18a2417 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:17.164181 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-982607fe-a6dc-4c46-9b5f-4b90b18a2417 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:17.164766 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-982607fe-a6dc-4c46-9b5f-4b90b18a2417 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:17.331905 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-982607fe-a6dc-4c46-9b5f-4b90b18a2417 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:17.341427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-982607fe-a6dc-4c46-9b5f-4b90b18a2417 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1315 microversion: 2.1 time: 0.190900 Jun 16 14:59:17.342255 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 173/342] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:17 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:17.459375 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b3c09ec3-72c2-4fa9-9dfe-024b344782ad tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:17.460010 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b3c09ec3-72c2-4fa9-9dfe-024b344782ad tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:17.467556 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3c09ec3-72c2-4fa9-9dfe-024b344782ad tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:17.468356 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3c09ec3-72c2-4fa9-9dfe-024b344782ad tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:17.469281 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3c09ec3-72c2-4fa9-9dfe-024b344782ad tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:17.469730 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3c09ec3-72c2-4fa9-9dfe-024b344782ad tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:17.651524 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b3c09ec3-72c2-4fa9-9dfe-024b344782ad tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:17.661172 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b3c09ec3-72c2-4fa9-9dfe-024b344782ad tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.210276 Jun 16 14:59:17.661751 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 170/343] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:17 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:18.055229 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b438083f-4f21-49cd-a52b-753e8b4a428e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:18.056244 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b438083f-4f21-49cd-a52b-753e8b4a428e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:18.064259 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b438083f-4f21-49cd-a52b-753e8b4a428e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:18.064717 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b438083f-4f21-49cd-a52b-753e8b4a428e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:18.065541 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b438083f-4f21-49cd-a52b-753e8b4a428e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:18.066092 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b438083f-4f21-49cd-a52b-753e8b4a428e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:18.110403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b438083f-4f21-49cd-a52b-753e8b4a428e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:18.111033 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b438083f-4f21-49cd-a52b-753e8b4a428e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:18.111499 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-b438083f-4f21-49cd-a52b-753e8b4a428e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lazy-loading 'fault' on Instance uuid fd17881d-ac5f-44ca-a709-a52350a37a18 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:59:18.161247 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b438083f-4f21-49cd-a52b-753e8b4a428e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c246b5f70c54d678d827ea43d5c7a38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0788d395b4e4632b29e263608e28973', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:18.172356 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b438083f-4f21-49cd-a52b-753e8b4a428e tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 200 len: 1350 microversion: 2.1 time: 0.124643 Jun 16 14:59:18.173136 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 174/344] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:18 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 1350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:18.360773 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-210f9436-d173-4ccb-9f57-b8f6e0c11927 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:18.361577 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-210f9436-d173-4ccb-9f57-b8f6e0c11927 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:18.363977 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=86 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:18.370640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-210f9436-d173-4ccb-9f57-b8f6e0c11927 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:18.371090 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-210f9436-d173-4ccb-9f57-b8f6e0c11927 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:18.372214 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-210f9436-d173-4ccb-9f57-b8f6e0c11927 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:18.372748 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-210f9436-d173-4ccb-9f57-b8f6e0c11927 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:18.680410 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a1f7069b-c0f7-4355-968d-93b94ab84955 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:18.681353 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a1f7069b-c0f7-4355-968d-93b94ab84955 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:18.696153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a1f7069b-c0f7-4355-968d-93b94ab84955 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:18.696600 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a1f7069b-c0f7-4355-968d-93b94ab84955 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:18.698303 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a1f7069b-c0f7-4355-968d-93b94ab84955 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:18.700275 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a1f7069b-c0f7-4355-968d-93b94ab84955 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:18.709239 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-210f9436-d173-4ccb-9f57-b8f6e0c11927 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:18.723100 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-210f9436-d173-4ccb-9f57-b8f6e0c11927 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1315 microversion: 2.1 time: 0.366063 Jun 16 14:59:18.724907 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 171/345] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:18 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:18.933088 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a1f7069b-c0f7-4355-968d-93b94ab84955 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:18.941538 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a1f7069b-c0f7-4355-968d-93b94ab84955 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.265713 Jun 16 14:59:18.946194 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 175/346] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:18 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:19.191199 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-48a03c9f-c71c-49b1-9cbd-a8cd83ecc3bf tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:19.191819 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-48a03c9f-c71c-49b1-9cbd-a8cd83ecc3bf tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:19.201066 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-48a03c9f-c71c-49b1-9cbd-a8cd83ecc3bf tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:19.204872 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-48a03c9f-c71c-49b1-9cbd-a8cd83ecc3bf tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:19.204872 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-48a03c9f-c71c-49b1-9cbd-a8cd83ecc3bf tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:19.204872 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-48a03c9f-c71c-49b1-9cbd-a8cd83ecc3bf tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:19.220623 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-48a03c9f-c71c-49b1-9cbd-a8cd83ecc3bf tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] HTTP exception thrown: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-48a03c9f-c71c-49b1-9cbd-a8cd83ecc3bf tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Request method failure captured: Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 HTTP/1.1 Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TTvsdc5YG_TWT6OyGxtcJi0HTzrhRgZN26yTRCgphnUtzyiNQZpxDVsYiIB4gYOeAO04yBxTybvSbX6Bzo6GUZTxRogNEL_ojdoOmYq9nDoUkU5Ll_qAqMUc2aVsHNqXTreN2in0Y9iZGP71P1nnUjNZpiwpTSpngaqKEsLlu_ZRA Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: a0788d395b4e4632b29e263608e28973 Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-DeleteServersTestJSON-504414535 Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 14:59:19.264107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 14:59:19.265755 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a0788d395b4e4632b29e263608e28973", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a0788d395b4e4632b29e263608e28973"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a0788d395b4e4632b29e263608e28973"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a0788d395b4e4632b29e263608e28973"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:59:19.265755 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-DeleteServersTestJSON-504414535 Jun 16 14:59:19.265755 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: a0788d395b4e4632b29e263608e28973 Jun 16 14:59:19.265755 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-DeleteServersTestJSON-504414535 Jun 16 14:59:19.265755 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-DeleteServersTestJSON-504414535-project Jun 16 14:59:19.265755 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 14:59:19.265755 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 14:59:19.265755 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 1c246b5f70c54d678d827ea43d5c7a38 Jun 16 14:59:19.265755 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-DeleteServersTestJSON-504414535-project Jun 16 14:59:19.265755 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 14:59:19.265755 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:19.265755 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': 'fd17881d-ac5f-44ca-a709-a52350a37a18'} Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:59:19.266502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:59:19.267958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:59:19.267958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:59:19.267958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:59:19.267958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:59:19.267958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:59:19.267958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:59:19.267958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:59:19.267958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:19.267958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:59:19.267958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:59:19.267958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:59:19.267958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:19.267958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:59:19.267958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:59:19.267958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:59:19.267958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:59:19.267958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:19.267958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:59:19.269348 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-48a03c9f-c71c-49b1-9cbd-a8cd83ecc3bf tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Returning 404 to user: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:59:19.269348 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-48a03c9f-c71c-49b1-9cbd-a8cd83ecc3bf tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 404 len: 111 microversion: 2.1 time: 0.079808 Jun 16 14:59:19.269348 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 172/347] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:19 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:59:19.409675 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9b866560-f907-4438-a242-0ac55843e283 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:19.410567 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9b866560-f907-4438-a242-0ac55843e283 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:19.418330 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9b866560-f907-4438-a242-0ac55843e283 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:19.418783 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9b866560-f907-4438-a242-0ac55843e283 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:19.419594 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9b866560-f907-4438-a242-0ac55843e283 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:19.420013 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9b866560-f907-4438-a242-0ac55843e283 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:19.434133 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-9b866560-f907-4438-a242-0ac55843e283 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] HTTP exception thrown: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9b866560-f907-4438-a242-0ac55843e283 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Request method failure captured: Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18/os-volume_attachments HTTP/1.1 Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0TTvsdc5YG_TWT6OyGxtcJi0HTzrhRgZN26yTRCgphnUtzyiNQZpxDVsYiIB4gYOeAO04yBxTybvSbX6Bzo6GUZTxRogNEL_ojdoOmYq9nDoUkU5Ll_qAqMUc2aVsHNqXTreN2in0Y9iZGP71P1nnUjNZpiwpTSpngaqKEsLlu_ZRA Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: a0788d395b4e4632b29e263608e28973 Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-DeleteServersTestJSON-504414535 Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 14:59:19.438523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 14:59:19.439820 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a0788d395b4e4632b29e263608e28973", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a0788d395b4e4632b29e263608e28973"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a0788d395b4e4632b29e263608e28973"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a0788d395b4e4632b29e263608e28973"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:59:19.439820 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-DeleteServersTestJSON-504414535 Jun 16 14:59:19.439820 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: a0788d395b4e4632b29e263608e28973 Jun 16 14:59:19.439820 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-DeleteServersTestJSON-504414535 Jun 16 14:59:19.439820 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-DeleteServersTestJSON-504414535-project Jun 16 14:59:19.439820 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 14:59:19.439820 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 14:59:19.439820 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: 1c246b5f70c54d678d827ea43d5c7a38 Jun 16 14:59:19.439820 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-DeleteServersTestJSON-504414535-project Jun 16 14:59:19.439820 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 14:59:19.439820 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:19.439820 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'server_id': 'fd17881d-ac5f-44ca-a709-a52350a37a18'} Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:59:19.440479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:19.441574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:59:19.442608 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9b866560-f907-4438-a242-0ac55843e283 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Returning 404 to user: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:59:19.442608 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9b866560-f907-4438-a242-0ac55843e283 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034443 Jun 16 14:59:19.442608 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 176/348] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 14:59:19 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:59:19.741223 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d3663e47-981e-472e-b9b4-eebe5f9e9efc tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:19.742380 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d3663e47-981e-472e-b9b4-eebe5f9e9efc tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:19.749271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d3663e47-981e-472e-b9b4-eebe5f9e9efc tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:19.749728 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d3663e47-981e-472e-b9b4-eebe5f9e9efc tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:19.750508 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d3663e47-981e-472e-b9b4-eebe5f9e9efc tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:19.750947 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d3663e47-981e-472e-b9b4-eebe5f9e9efc tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:19.904639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d3663e47-981e-472e-b9b4-eebe5f9e9efc tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:19.914038 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d3663e47-981e-472e-b9b4-eebe5f9e9efc tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1315 microversion: 2.1 time: 0.176415 Jun 16 14:59:19.914653 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 173/349] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:19 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:19.958958 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c3505ee8-9f9e-48b2-961e-bffdee76d9ee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:19.959570 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c3505ee8-9f9e-48b2-961e-bffdee76d9ee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:19.966048 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c3505ee8-9f9e-48b2-961e-bffdee76d9ee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:19.966499 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c3505ee8-9f9e-48b2-961e-bffdee76d9ee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:19.967272 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c3505ee8-9f9e-48b2-961e-bffdee76d9ee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:19.967701 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c3505ee8-9f9e-48b2-961e-bffdee76d9ee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:20.123544 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c3505ee8-9f9e-48b2-961e-bffdee76d9ee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:20.131615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c3505ee8-9f9e-48b2-961e-bffdee76d9ee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.176450 Jun 16 14:59:20.132228 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 177/350] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:19 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:20.931658 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c321a737-bd79-4708-a562-6ecf6fbe6e9e tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:20.932464 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c321a737-bd79-4708-a562-6ecf6fbe6e9e tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:20.939492 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c321a737-bd79-4708-a562-6ecf6fbe6e9e tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:20.939944 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c321a737-bd79-4708-a562-6ecf6fbe6e9e tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:20.940716 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c321a737-bd79-4708-a562-6ecf6fbe6e9e tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:20.941453 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c321a737-bd79-4708-a562-6ecf6fbe6e9e tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:21.089924 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c321a737-bd79-4708-a562-6ecf6fbe6e9e tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:21.095656 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-bb583712-e74e-4170-aa00-9af515040b62 req-9c5af9a9-563b-4420-a09c-ce6cd7c08cee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81ae5bb3-0883-4d56-8204-f83a030a3de2", "name": "network-vif-plugged", "status": "completed", "tag": "16a983ba-ff5a-4173-91d2-22e55f7dc337"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:21.098719 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c321a737-bd79-4708-a562-6ecf6fbe6e9e tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1315 microversion: 2.1 time: 0.171363 Jun 16 14:59:21.109207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-bb583712-e74e-4170-aa00-9af515040b62 req-9c5af9a9-563b-4420-a09c-ce6cd7c08cee service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:21.109661 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 174/351] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:20 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:21.109829 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-bb583712-e74e-4170-aa00-9af515040b62 req-9c5af9a9-563b-4420-a09c-ce6cd7c08cee service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:21.122139 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-bb583712-e74e-4170-aa00-9af515040b62 req-9c5af9a9-563b-4420-a09c-ce6cd7c08cee service nova] Creating event network-vif-plugged:16a983ba-ff5a-4173-91d2-22e55f7dc337 for instance 81ae5bb3-0883-4d56-8204-f83a030a3de2 on hv-cinder-83716 Jun 16 14:59:21.128144 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-bb583712-e74e-4170-aa00-9af515040b62 req-9c5af9a9-563b-4420-a09c-ce6cd7c08cee service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036169 Jun 16 14:59:21.128929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 178/352] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 14:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:59:21.149341 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-280508c8-bb2b-45fc-97b0-36b925dbc43c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:21.149963 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-280508c8-bb2b-45fc-97b0-36b925dbc43c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:21.159972 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-280508c8-bb2b-45fc-97b0-36b925dbc43c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:21.160689 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-280508c8-bb2b-45fc-97b0-36b925dbc43c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:21.162084 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-280508c8-bb2b-45fc-97b0-36b925dbc43c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:21.163087 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-280508c8-bb2b-45fc-97b0-36b925dbc43c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:21.320438 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-280508c8-bb2b-45fc-97b0-36b925dbc43c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:21.328928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-280508c8-bb2b-45fc-97b0-36b925dbc43c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.183782 Jun 16 14:59:21.329503 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 175/353] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:21 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:21.703746 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b9ca4ea2-3269-48dc-9599-01dbd88ebecb tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:21.704358 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b9ca4ea2-3269-48dc-9599-01dbd88ebecb tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:21.710843 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b9ca4ea2-3269-48dc-9599-01dbd88ebecb tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:21.711290 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b9ca4ea2-3269-48dc-9599-01dbd88ebecb tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:21.712065 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b9ca4ea2-3269-48dc-9599-01dbd88ebecb tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:21.712499 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b9ca4ea2-3269-48dc-9599-01dbd88ebecb tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:21.726997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-b9ca4ea2-3269-48dc-9599-01dbd88ebecb tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] HTTP exception thrown: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b9ca4ea2-3269-48dc-9599-01dbd88ebecb tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Request method failure captured: Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: DELETE /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 HTTP/1.1 Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0TTvsdc5YG_TWT6OyGxtcJi0HTzrhRgZN26yTRCgphnUtzyiNQZpxDVsYiIB4gYOeAO04yBxTybvSbX6Bzo6GUZTxRogNEL_ojdoOmYq9nDoUkU5Ll_qAqMUc2aVsHNqXTreN2in0Y9iZGP71P1nnUjNZpiwpTSpngaqKEsLlu_ZRA Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: a0788d395b4e4632b29e263608e28973 Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-DeleteServersTestJSON-504414535 Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 14:59:21.729419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 14:59:21.732020 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a0788d395b4e4632b29e263608e28973", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a0788d395b4e4632b29e263608e28973"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a0788d395b4e4632b29e263608e28973"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a0788d395b4e4632b29e263608e28973"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:59:21.732020 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-DeleteServersTestJSON-504414535 Jun 16 14:59:21.732020 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: a0788d395b4e4632b29e263608e28973 Jun 16 14:59:21.732020 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-DeleteServersTestJSON-504414535 Jun 16 14:59:21.732020 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-DeleteServersTestJSON-504414535-project Jun 16 14:59:21.732020 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 14:59:21.732020 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 14:59:21.732020 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: 1c246b5f70c54d678d827ea43d5c7a38 Jun 16 14:59:21.732020 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-DeleteServersTestJSON-504414535-project Jun 16 14:59:21.732020 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 14:59:21.732020 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:21.732020 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': 'fd17881d-ac5f-44ca-a709-a52350a37a18'} Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:59:21.733638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:21.736098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:59:21.738366 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b9ca4ea2-3269-48dc-9599-01dbd88ebecb tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Returning 404 to user: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:59:21.738366 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b9ca4ea2-3269-48dc-9599-01dbd88ebecb tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "DELETE /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 404 len: 111 microversion: 2.1 time: 0.031564 Jun 16 14:59:21.738366 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 179/354] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 14:59:21 2022] DELETE /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:59:21.739685 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4fbab6fc-f398-42a9-81e1-e76505bb3597 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:21.740296 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4fbab6fc-f398-42a9-81e1-e76505bb3597 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] [instance: fd17881d-ac5f-44ca-a709-a52350a37a18] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:21.747105 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4fbab6fc-f398-42a9-81e1-e76505bb3597 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:21.747558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4fbab6fc-f398-42a9-81e1-e76505bb3597 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:21.748421 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4fbab6fc-f398-42a9-81e1-e76505bb3597 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:21.748883 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4fbab6fc-f398-42a9-81e1-e76505bb3597 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:21.763834 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-4fbab6fc-f398-42a9-81e1-e76505bb3597 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] HTTP exception thrown: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4fbab6fc-f398-42a9-81e1-e76505bb3597 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Request method failure captured: Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 HTTP/1.1 Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TTvsdc5YG_TWT6OyGxtcJi0HTzrhRgZN26yTRCgphnUtzyiNQZpxDVsYiIB4gYOeAO04yBxTybvSbX6Bzo6GUZTxRogNEL_ojdoOmYq9nDoUkU5Ll_qAqMUc2aVsHNqXTreN2in0Y9iZGP71P1nnUjNZpiwpTSpngaqKEsLlu_ZRA Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: a0788d395b4e4632b29e263608e28973 Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-DeleteServersTestJSON-504414535 Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 14:59:21.765430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 14:59:21.766860 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_a0788d395b4e4632b29e263608e28973", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a0788d395b4e4632b29e263608e28973"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/a0788d395b4e4632b29e263608e28973"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/a0788d395b4e4632b29e263608e28973"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:59:21.766860 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-DeleteServersTestJSON-504414535 Jun 16 14:59:21.766860 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: a0788d395b4e4632b29e263608e28973 Jun 16 14:59:21.766860 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-DeleteServersTestJSON-504414535 Jun 16 14:59:21.766860 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-DeleteServersTestJSON-504414535-project Jun 16 14:59:21.766860 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 14:59:21.766860 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 14:59:21.766860 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 1c246b5f70c54d678d827ea43d5c7a38 Jun 16 14:59:21.766860 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-DeleteServersTestJSON-504414535-project Jun 16 14:59:21.766860 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 14:59:21.766860 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:21.766860 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': 'fd17881d-ac5f-44ca-a709-a52350a37a18'} Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:59:21.767724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:59:21.768922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:59:21.768922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:59:21.768922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:59:21.768922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:59:21.768922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:59:21.768922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:59:21.768922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:59:21.768922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:21.768922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:59:21.768922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:59:21.768922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:59:21.768922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:21.768922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:59:21.768922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:59:21.768922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:59:21.768922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:59:21.768922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. Jun 16 14:59:21.768922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 14:59:21.769911 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4fbab6fc-f398-42a9-81e1-e76505bb3597 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] Returning 404 to user: Instance fd17881d-ac5f-44ca-a709-a52350a37a18 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:59:21.769911 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4fbab6fc-f398-42a9-81e1-e76505bb3597 tempest-DeleteServersTestJSON-504414535 tempest-DeleteServersTestJSON-504414535-project] 10.222.0.72 "GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18" status: 404 len: 111 microversion: 2.1 time: 0.031238 Jun 16 14:59:21.769911 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 176/355] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:21 2022] GET /compute/v2.1/servers/fd17881d-ac5f-44ca-a709-a52350a37a18 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:59:22.117139 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-95faacf4-cf94-448a-8200-870a73b74c3d tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:22.117884 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-95faacf4-cf94-448a-8200-870a73b74c3d tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:22.124272 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-95faacf4-cf94-448a-8200-870a73b74c3d tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:22.125041 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-95faacf4-cf94-448a-8200-870a73b74c3d tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:22.125961 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-95faacf4-cf94-448a-8200-870a73b74c3d tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:22.126382 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-95faacf4-cf94-448a-8200-870a73b74c3d tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:22.348204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6eba7576-0e74-447f-b62c-5efbfce9e582 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:22.348959 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6eba7576-0e74-447f-b62c-5efbfce9e582 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:22.356525 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6eba7576-0e74-447f-b62c-5efbfce9e582 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:22.360562 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6eba7576-0e74-447f-b62c-5efbfce9e582 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:22.361651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6eba7576-0e74-447f-b62c-5efbfce9e582 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:22.362432 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6eba7576-0e74-447f-b62c-5efbfce9e582 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:22.509708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6eba7576-0e74-447f-b62c-5efbfce9e582 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:22.517449 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6eba7576-0e74-447f-b62c-5efbfce9e582 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.173639 Jun 16 14:59:22.518039 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 177/356] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:22 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:22.588442 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-95faacf4-cf94-448a-8200-870a73b74c3d tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:22.596281 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-95faacf4-cf94-448a-8200-870a73b74c3d tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1315 microversion: 2.1 time: 0.482903 Jun 16 14:59:22.596901 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 180/357] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:22 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:23.536873 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-996634fb-83b9-4fd4-8825-d078c4c04e4d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:23.537653 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-996634fb-83b9-4fd4-8825-d078c4c04e4d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:23.545732 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-996634fb-83b9-4fd4-8825-d078c4c04e4d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:23.546657 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-996634fb-83b9-4fd4-8825-d078c4c04e4d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:23.547473 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-996634fb-83b9-4fd4-8825-d078c4c04e4d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:23.547921 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-996634fb-83b9-4fd4-8825-d078c4c04e4d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:23.617801 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-02506c32-8033-4b84-950d-8e550718762a tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:23.618421 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-02506c32-8033-4b84-950d-8e550718762a tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:23.628746 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-02506c32-8033-4b84-950d-8e550718762a tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:23.629226 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-02506c32-8033-4b84-950d-8e550718762a tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:23.638308 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-02506c32-8033-4b84-950d-8e550718762a tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:23.638308 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-02506c32-8033-4b84-950d-8e550718762a tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:23.778647 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-996634fb-83b9-4fd4-8825-d078c4c04e4d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:23.787378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-996634fb-83b9-4fd4-8825-d078c4c04e4d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.254699 Jun 16 14:59:23.788729 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 178/358] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:23 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:23.935918 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-02506c32-8033-4b84-950d-8e550718762a tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:23.948157 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-02506c32-8033-4b84-950d-8e550718762a tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1315 microversion: 2.1 time: 0.336188 Jun 16 14:59:23.948873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 181/359] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:23 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:24.805705 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3f6dcdd1-1610-442c-83ac-6fc8e90ff7f5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:24.806351 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3f6dcdd1-1610-442c-83ac-6fc8e90ff7f5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:24.814424 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3f6dcdd1-1610-442c-83ac-6fc8e90ff7f5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:24.815899 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3f6dcdd1-1610-442c-83ac-6fc8e90ff7f5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:24.816790 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3f6dcdd1-1610-442c-83ac-6fc8e90ff7f5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:24.817493 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3f6dcdd1-1610-442c-83ac-6fc8e90ff7f5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:24.976658 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-89d70666-b01d-4320-afcf-ae32c8ffa84b tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:24.977544 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-89d70666-b01d-4320-afcf-ae32c8ffa84b tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:24.996688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89d70666-b01d-4320-afcf-ae32c8ffa84b tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:24.996688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89d70666-b01d-4320-afcf-ae32c8ffa84b tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:25.002559 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89d70666-b01d-4320-afcf-ae32c8ffa84b tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:25.003029 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89d70666-b01d-4320-afcf-ae32c8ffa84b tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:25.253052 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-89d70666-b01d-4320-afcf-ae32c8ffa84b tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:25.264699 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-89d70666-b01d-4320-afcf-ae32c8ffa84b tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1465 microversion: 2.1 time: 0.300757 Jun 16 14:59:25.264699 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 182/360] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:24 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1465 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:25.303701 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3f6dcdd1-1610-442c-83ac-6fc8e90ff7f5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:25.343248 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2916665b-9905-413d-845d-84f95fe17ff4 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:25.343927 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2916665b-9905-413d-845d-84f95fe17ff4 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:25.344271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3f6dcdd1-1610-442c-83ac-6fc8e90ff7f5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.542304 Jun 16 14:59:25.344968 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 179/361] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:24 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:25.359756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2916665b-9905-413d-845d-84f95fe17ff4 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:25.360566 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2916665b-9905-413d-845d-84f95fe17ff4 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:25.361651 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2916665b-9905-413d-845d-84f95fe17ff4 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:25.362081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2916665b-9905-413d-845d-84f95fe17ff4 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:25.429362 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2916665b-9905-413d-845d-84f95fe17ff4 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 14:59:25.564569 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2916665b-9905-413d-845d-84f95fe17ff4 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "DELETE /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 204 len: 0 microversion: 2.1 time: 0.225107 Jun 16 14:59:25.565224 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 183/362] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 14:59:25 2022] DELETE /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 14:59:25.573985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4983fae3-1680-4111-af65-aea63fec8b95 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:25.574597 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4983fae3-1680-4111-af65-aea63fec8b95 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:25.584776 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4983fae3-1680-4111-af65-aea63fec8b95 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:25.588815 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4983fae3-1680-4111-af65-aea63fec8b95 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:25.594469 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4983fae3-1680-4111-af65-aea63fec8b95 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:25.595170 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4983fae3-1680-4111-af65-aea63fec8b95 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:25.599617 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:25.763800 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4983fae3-1680-4111-af65-aea63fec8b95 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:25.771779 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4983fae3-1680-4111-af65-aea63fec8b95 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1471 microversion: 2.1 time: 0.201903 Jun 16 14:59:25.772725 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 180/363] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:25 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1471 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:26.372524 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f27ce426-a987-454d-9198-8f0cefc9254a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:26.374242 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f27ce426-a987-454d-9198-8f0cefc9254a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:26.401443 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f27ce426-a987-454d-9198-8f0cefc9254a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:26.405159 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f27ce426-a987-454d-9198-8f0cefc9254a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:26.406772 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f27ce426-a987-454d-9198-8f0cefc9254a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:26.409671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f27ce426-a987-454d-9198-8f0cefc9254a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:26.607178 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f27ce426-a987-454d-9198-8f0cefc9254a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:26.620427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f27ce426-a987-454d-9198-8f0cefc9254a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.260784 Jun 16 14:59:26.621552 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 184/364] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:26 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:26.795096 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-64131aec-97c2-4d07-9a55-9b67d933c9c5 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:26.796480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-64131aec-97c2-4d07-9a55-9b67d933c9c5 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:26.808921 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-64131aec-97c2-4d07-9a55-9b67d933c9c5 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:26.810095 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-64131aec-97c2-4d07-9a55-9b67d933c9c5 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:26.811430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-64131aec-97c2-4d07-9a55-9b67d933c9c5 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:26.812172 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-64131aec-97c2-4d07-9a55-9b67d933c9c5 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:27.362374 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-64131aec-97c2-4d07-9a55-9b67d933c9c5 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:27.380376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-64131aec-97c2-4d07-9a55-9b67d933c9c5 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1471 microversion: 2.1 time: 0.593777 Jun 16 14:59:27.390457 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 181/365] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:26 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1471 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:27.639246 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3ec47b41-8968-4a8e-abe1-4cf6617d5423 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:27.639852 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3ec47b41-8968-4a8e-abe1-4cf6617d5423 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:27.646781 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3ec47b41-8968-4a8e-abe1-4cf6617d5423 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:27.647242 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3ec47b41-8968-4a8e-abe1-4cf6617d5423 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:27.648567 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3ec47b41-8968-4a8e-abe1-4cf6617d5423 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:27.649042 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3ec47b41-8968-4a8e-abe1-4cf6617d5423 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:27.815731 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3ec47b41-8968-4a8e-abe1-4cf6617d5423 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:27.832393 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3ec47b41-8968-4a8e-abe1-4cf6617d5423 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.196293 Jun 16 14:59:27.833676 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 185/366] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:27 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:28.400866 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a6fa9884-0b8e-4847-9402-7a169b6097ab tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:28.402282 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a6fa9884-0b8e-4847-9402-7a169b6097ab tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:28.433422 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a6fa9884-0b8e-4847-9402-7a169b6097ab tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:28.434096 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a6fa9884-0b8e-4847-9402-7a169b6097ab tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:28.437621 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a6fa9884-0b8e-4847-9402-7a169b6097ab tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:28.438293 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a6fa9884-0b8e-4847-9402-7a169b6097ab tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:28.544960 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-07d58128-d297-4ca2-b7c9-da19fdfefc6c req-bc473962-80ab-4d90-be09-32e8a811107f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81ae5bb3-0883-4d56-8204-f83a030a3de2", "name": "network-vif-deleted", "tag": "16a983ba-ff5a-4173-91d2-22e55f7dc337"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:28.568088 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-07d58128-d297-4ca2-b7c9-da19fdfefc6c req-bc473962-80ab-4d90-be09-32e8a811107f service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:28.568925 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-07d58128-d297-4ca2-b7c9-da19fdfefc6c req-bc473962-80ab-4d90-be09-32e8a811107f service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:28.591615 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a6fa9884-0b8e-4847-9402-7a169b6097ab tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:28.603617 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a6fa9884-0b8e-4847-9402-7a169b6097ab tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1429 microversion: 2.1 time: 0.209307 Jun 16 14:59:28.605614 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-07d58128-d297-4ca2-b7c9-da19fdfefc6c req-bc473962-80ab-4d90-be09-32e8a811107f service nova] Creating event network-vif-deleted:16a983ba-ff5a-4173-91d2-22e55f7dc337 for instance 81ae5bb3-0883-4d56-8204-f83a030a3de2 on hv-cinder-83716 Jun 16 14:59:28.606723 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 182/367] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:28 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1429 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:28.630384 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-07d58128-d297-4ca2-b7c9-da19fdfefc6c req-bc473962-80ab-4d90-be09-32e8a811107f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087447 Jun 16 14:59:28.632715 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 186/368] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 14:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:59:28.856678 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d0c346b3-9ba7-43e7-adb5-4e23406979a0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:28.857568 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d0c346b3-9ba7-43e7-adb5-4e23406979a0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:28.864854 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d0c346b3-9ba7-43e7-adb5-4e23406979a0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:28.865318 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d0c346b3-9ba7-43e7-adb5-4e23406979a0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:28.866097 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d0c346b3-9ba7-43e7-adb5-4e23406979a0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:28.866657 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d0c346b3-9ba7-43e7-adb5-4e23406979a0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:29.036713 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d0c346b3-9ba7-43e7-adb5-4e23406979a0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:29.047875 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d0c346b3-9ba7-43e7-adb5-4e23406979a0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.201733 Jun 16 14:59:29.052975 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 183/369] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:28 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:29.626073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c17122fb-407a-498a-9342-5c64e1ee23a0 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:29.627061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c17122fb-407a-498a-9342-5c64e1ee23a0 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:29.639044 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c17122fb-407a-498a-9342-5c64e1ee23a0 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:29.639813 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c17122fb-407a-498a-9342-5c64e1ee23a0 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:29.641023 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c17122fb-407a-498a-9342-5c64e1ee23a0 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:29.642053 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c17122fb-407a-498a-9342-5c64e1ee23a0 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:29.686135 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c17122fb-407a-498a-9342-5c64e1ee23a0 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:29.687542 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c17122fb-407a-498a-9342-5c64e1ee23a0 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:29.688471 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-c17122fb-407a-498a-9342-5c64e1ee23a0 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lazy-loading 'fault' on Instance uuid 81ae5bb3-0883-4d56-8204-f83a030a3de2 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:59:29.758439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c17122fb-407a-498a-9342-5c64e1ee23a0 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:29.774366 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c17122fb-407a-498a-9342-5c64e1ee23a0 tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1305 microversion: 2.1 time: 0.154897 Jun 16 14:59:29.774886 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 187/370] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:29 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1305 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:30.067467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c8852983-213e-467a-95c9-bc4d0ed0ab40 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:30.068155 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c8852983-213e-467a-95c9-bc4d0ed0ab40 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:30.077041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8852983-213e-467a-95c9-bc4d0ed0ab40 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:30.077473 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8852983-213e-467a-95c9-bc4d0ed0ab40 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:30.078500 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8852983-213e-467a-95c9-bc4d0ed0ab40 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:30.078939 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8852983-213e-467a-95c9-bc4d0ed0ab40 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:30.352150 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c8852983-213e-467a-95c9-bc4d0ed0ab40 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:30.360029 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c8852983-213e-467a-95c9-bc4d0ed0ab40 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.296741 Jun 16 14:59:30.360770 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 184/371] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:30 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:30.807143 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e538d217-8557-4b9c-835a-180eae3b614c tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:30.808447 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e538d217-8557-4b9c-835a-180eae3b614c tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:30.816277 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e538d217-8557-4b9c-835a-180eae3b614c tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:30.817067 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e538d217-8557-4b9c-835a-180eae3b614c tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:30.819162 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e538d217-8557-4b9c-835a-180eae3b614c tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:30.819731 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e538d217-8557-4b9c-835a-180eae3b614c tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:30.868178 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:30.874002 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e538d217-8557-4b9c-835a-180eae3b614c tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:30.874835 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e538d217-8557-4b9c-835a-180eae3b614c tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:30.875460 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-e538d217-8557-4b9c-835a-180eae3b614c tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lazy-loading 'fault' on Instance uuid 81ae5bb3-0883-4d56-8204-f83a030a3de2 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 14:59:30.938940 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e538d217-8557-4b9c-835a-180eae3b614c tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0030bdbe0d0f466a97b37f4f5a83b02f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a75da564c3434ca8a1cff32b9edd4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:30.943181 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:30.950490 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e538d217-8557-4b9c-835a-180eae3b614c tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 200 len: 1305 microversion: 2.1 time: 0.158581 Jun 16 14:59:30.951452 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 188/372] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:30 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 1305 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:31.389755 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-431e2a7a-57ef-496f-bd22-38c54dbef85c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:31.390426 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-431e2a7a-57ef-496f-bd22-38c54dbef85c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:31.398562 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-431e2a7a-57ef-496f-bd22-38c54dbef85c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:31.399367 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-431e2a7a-57ef-496f-bd22-38c54dbef85c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:31.400564 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-431e2a7a-57ef-496f-bd22-38c54dbef85c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:31.401249 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-431e2a7a-57ef-496f-bd22-38c54dbef85c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:31.585669 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-431e2a7a-57ef-496f-bd22-38c54dbef85c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:31.595613 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-431e2a7a-57ef-496f-bd22-38c54dbef85c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.221690 Jun 16 14:59:31.596692 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 185/373] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:31 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:31.968824 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d0fb3698-6605-4c3e-a460-da8a54ca36ef tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:31.971626 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d0fb3698-6605-4c3e-a460-da8a54ca36ef tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] [instance: 81ae5bb3-0883-4d56-8204-f83a030a3de2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:31.978855 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d0fb3698-6605-4c3e-a460-da8a54ca36ef tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:31.979552 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d0fb3698-6605-4c3e-a460-da8a54ca36ef tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:31.980521 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d0fb3698-6605-4c3e-a460-da8a54ca36ef tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:31.981154 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d0fb3698-6605-4c3e-a460-da8a54ca36ef tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:32.004428 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-d0fb3698-6605-4c3e-a460-da8a54ca36ef tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] HTTP exception thrown: Instance 81ae5bb3-0883-4d56-8204-f83a030a3de2 could not be found. Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d0fb3698-6605-4c3e-a460-da8a54ca36ef tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Request method failure captured: Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 HTTP/1.1 Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0UoIxXd7aG2aFv58ZoWaru4CN-QPlBGHmHdS6JbI_8aapYBVtaH2Kj6Hr3dRjovHeEvBX7kGMARgJm_9s7IOI0cIhbgBsrqrsn2hGLiv13nsXgZBQpvJwL9mjwsKiSVrKJch1rDWtOcfp08hqB3gCuaMsQI1ZBKpKTCxwEqjtpefto Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 22a75da564c3434ca8a1cff32b9edd4d Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-VolumesNegativeTest-1322675060 Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 14:59:32.006336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 14:59:32.008392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_22a75da564c3434ca8a1cff32b9edd4d", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/22a75da564c3434ca8a1cff32b9edd4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/22a75da564c3434ca8a1cff32b9edd4d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/22a75da564c3434ca8a1cff32b9edd4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 14:59:32.008392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-VolumesNegativeTest-1322675060 Jun 16 14:59:32.008392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 22a75da564c3434ca8a1cff32b9edd4d Jun 16 14:59:32.008392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-VolumesNegativeTest-1322675060 Jun 16 14:59:32.008392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-VolumesNegativeTest-1322675060-project Jun 16 14:59:32.008392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 14:59:32.008392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 14:59:32.008392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: 0030bdbe0d0f466a97b37f4f5a83b02f Jun 16 14:59:32.008392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-VolumesNegativeTest-1322675060-project Jun 16 14:59:32.008392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 14:59:32.008392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance 81ae5bb3-0883-4d56-8204-f83a030a3de2 could not be found. Jun 16 14:59:32.008392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': '81ae5bb3-0883-4d56-8204-f83a030a3de2'} Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81ae5bb3-0883-4d56-8204-f83a030a3de2 could not be found. Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 14:59:32.009253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 14:59:32.010687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 14:59:32.010687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 14:59:32.010687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 14:59:32.010687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 14:59:32.010687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 14:59:32.010687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 14:59:32.010687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 14:59:32.010687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81ae5bb3-0883-4d56-8204-f83a030a3de2 could not be found. Jun 16 14:59:32.010687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:59:32.010687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 14:59:32.010687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:59:32.010687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 14:59:32.010687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 14:59:32.010687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 14:59:32.010687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 14:59:32.010687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 14:59:32.010687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81ae5bb3-0883-4d56-8204-f83a030a3de2 could not be found. Jun 16 14:59:32.010687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 14:59:32.011841 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d0fb3698-6605-4c3e-a460-da8a54ca36ef tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] Returning 404 to user: Instance 81ae5bb3-0883-4d56-8204-f83a030a3de2 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 14:59:32.011841 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d0fb3698-6605-4c3e-a460-da8a54ca36ef tempest-VolumesNegativeTest-1322675060 tempest-VolumesNegativeTest-1322675060-project] 10.222.0.72 "GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2" status: 404 len: 111 microversion: 2.1 time: 0.046929 Jun 16 14:59:32.012330 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 189/374] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:31 2022] GET /compute/v2.1/servers/81ae5bb3-0883-4d56-8204-f83a030a3de2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 14:59:32.615585 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-761dcb95-e6c9-4d0c-af59-cf3160c717dd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:32.617630 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-761dcb95-e6c9-4d0c-af59-cf3160c717dd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:32.626263 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-761dcb95-e6c9-4d0c-af59-cf3160c717dd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:32.627654 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-761dcb95-e6c9-4d0c-af59-cf3160c717dd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:32.629132 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-761dcb95-e6c9-4d0c-af59-cf3160c717dd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:32.629836 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-761dcb95-e6c9-4d0c-af59-cf3160c717dd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:32.797957 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-761dcb95-e6c9-4d0c-af59-cf3160c717dd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:32.810736 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-761dcb95-e6c9-4d0c-af59-cf3160c717dd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.199688 Jun 16 14:59:32.812752 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 186/375] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:32 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:33.832797 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a97c765d-db59-42a7-90e2-b110af3ebfb5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:33.833590 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a97c765d-db59-42a7-90e2-b110af3ebfb5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:33.858265 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a97c765d-db59-42a7-90e2-b110af3ebfb5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:33.858964 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a97c765d-db59-42a7-90e2-b110af3ebfb5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:33.865197 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a97c765d-db59-42a7-90e2-b110af3ebfb5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:33.865866 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a97c765d-db59-42a7-90e2-b110af3ebfb5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:34.111582 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a97c765d-db59-42a7-90e2-b110af3ebfb5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:34.120192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a97c765d-db59-42a7-90e2-b110af3ebfb5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.291142 Jun 16 14:59:34.120907 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 190/376] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:33 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:34.503328 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-41757c39-dbeb-466e-959e-9a85c8612965 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Action: 'create', calling method: .version_select at 0x7faab66e45e0>, body: {"keypair": {"name": "tempest-keypair-104338804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKxnWU0HIu1/vZ19tLgQiOno3tHcoqlind+LKHvZc7mboxsyPJ6TYNR88evGo0uRpCNESj57GlP3xF3n9Tf60DE5aox4Hp0aqMM/2u7oTYE+hzgU20dopmaXI8ryrX5vQ=="}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:34.525153 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-41757c39-dbeb-466e-959e-9a85c8612965 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Getting quotas for project 3c94142f5fe543e28710c9bb2916662c. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:59:34.539781 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-41757c39-dbeb-466e-959e-9a85c8612965 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Getting quotas for user b424792631ac40f48c3f3c1529d699b3 and project 3c94142f5fe543e28710c9bb2916662c. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:59:34.575034 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-41757c39-dbeb-466e-959e-9a85c8612965 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.382468 Jun 16 14:59:34.575842 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 187/377] 10.222.0.72 () {60 vars in 1158 bytes} [Thu Jun 16 14:59:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:59:35.145658 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-dc9ec199-edc4-488e-92c4-8f4464798c0e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:35.147155 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-dc9ec199-edc4-488e-92c4-8f4464798c0e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:35.155374 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dc9ec199-edc4-488e-92c4-8f4464798c0e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:35.155877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dc9ec199-edc4-488e-92c4-8f4464798c0e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:35.156665 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dc9ec199-edc4-488e-92c4-8f4464798c0e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:35.157139 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dc9ec199-edc4-488e-92c4-8f4464798c0e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:35.426579 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-dc9ec199-edc4-488e-92c4-8f4464798c0e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:35.436888 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-dc9ec199-edc4-488e-92c4-8f4464798c0e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.297016 Jun 16 14:59:35.437575 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 191/378] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:35 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:36.285899 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3c5fa209-8fcf-45a3-ac3c-d991c7c2d475 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-680088785", "imageRef": "23371504-a4d6-4064-90b4-87bfd0a15170", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e965c323-79ff-4b11-8aaa-a2df835467d6"}], "security_groups": [{"name": "tempest-securitygroup--365475633"}], "key_name": "tempest-keypair-104338804", "user_data": "}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:36.419497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-3c5fa209-8fcf-45a3-ac3c-d991c7c2d475 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] validate_networks() for [('e965c323-79ff-4b11-8aaa-a2df835467d6', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:59:36.455619 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-12cecff6-dcc0-4d28-8f88-6d8b67de6783 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:36.457878 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-12cecff6-dcc0-4d28-8f88-6d8b67de6783 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:36.467844 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-12cecff6-dcc0-4d28-8f88-6d8b67de6783 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:36.468462 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-12cecff6-dcc0-4d28-8f88-6d8b67de6783 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:36.469374 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-12cecff6-dcc0-4d28-8f88-6d8b67de6783 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:36.469777 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-12cecff6-dcc0-4d28-8f88-6d8b67de6783 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:36.675794 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-12cecff6-dcc0-4d28-8f88-6d8b67de6783 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:36.693312 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-12cecff6-dcc0-4d28-8f88-6d8b67de6783 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.241506 Jun 16 14:59:36.695893 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 192/379] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:36 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:36.903058 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-3c5fa209-8fcf-45a3-ac3c-d991c7c2d475 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:59:36.903619 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-3c5fa209-8fcf-45a3-ac3c-d991c7c2d475 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:59:36.904192 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-3c5fa209-8fcf-45a3-ac3c-d991c7c2d475 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:59:36.904663 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-3c5fa209-8fcf-45a3-ac3c-d991c7c2d475 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:59:36.905094 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-3c5fa209-8fcf-45a3-ac3c-d991c7c2d475 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:59:36.915259 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3c5fa209-8fcf-45a3-ac3c-d991c7c2d475 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:36.915709 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3c5fa209-8fcf-45a3-ac3c-d991c7c2d475 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:36.916510 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3c5fa209-8fcf-45a3-ac3c-d991c7c2d475 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:36.916980 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3c5fa209-8fcf-45a3-ac3c-d991c7c2d475 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:36.935219 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-3c5fa209-8fcf-45a3-ac3c-d991c7c2d475 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Getting quotas for project 3c94142f5fe543e28710c9bb2916662c. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:59:36.939840 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-3c5fa209-8fcf-45a3-ac3c-d991c7c2d475 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Getting quotas for user b424792631ac40f48c3f3c1529d699b3 and project 3c94142f5fe543e28710c9bb2916662c. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:59:36.952058 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3c5fa209-8fcf-45a3-ac3c-d991c7c2d475 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:59:36.954375 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3c5fa209-8fcf-45a3-ac3c-d991c7c2d475 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23371504-a4d6-4064-90b4-87bfd0a15170',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:59:37.018099 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3c5fa209-8fcf-45a3-ac3c-d991c7c2d475 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.737610 Jun 16 14:59:37.021848 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 188/380] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 14:59:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:59:37.037642 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-516beb13-775e-45ba-9739-a8adec98761c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:37.038787 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-516beb13-775e-45ba-9739-a8adec98761c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:37.127987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-516beb13-775e-45ba-9739-a8adec98761c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:37.136415 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-516beb13-775e-45ba-9739-a8adec98761c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1236 microversion: 2.1 time: 0.105069 Jun 16 14:59:37.137483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 193/381] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:37 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1236 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:37.712621 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a5184663-54e0-470b-a70b-5c680862bc71 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:37.713569 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a5184663-54e0-470b-a70b-5c680862bc71 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:37.722505 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a5184663-54e0-470b-a70b-5c680862bc71 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:37.722961 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a5184663-54e0-470b-a70b-5c680862bc71 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:37.724595 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a5184663-54e0-470b-a70b-5c680862bc71 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:37.725302 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a5184663-54e0-470b-a70b-5c680862bc71 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:37.899521 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a5184663-54e0-470b-a70b-5c680862bc71 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:37.908670 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a5184663-54e0-470b-a70b-5c680862bc71 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.200136 Jun 16 14:59:37.910116 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 189/382] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:37 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:38.155310 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ef301070-d1c3-4c7c-bd65-501cd771d1c4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:38.156582 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ef301070-d1c3-4c7c-bd65-501cd771d1c4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:38.166208 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ef301070-d1c3-4c7c-bd65-501cd771d1c4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:38.166902 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ef301070-d1c3-4c7c-bd65-501cd771d1c4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:38.167782 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ef301070-d1c3-4c7c-bd65-501cd771d1c4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:38.168439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ef301070-d1c3-4c7c-bd65-501cd771d1c4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:38.267158 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ef301070-d1c3-4c7c-bd65-501cd771d1c4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:38.280475 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ef301070-d1c3-4c7c-bd65-501cd771d1c4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1240 microversion: 2.1 time: 0.129268 Jun 16 14:59:38.294294 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 194/383] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:38 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1240 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:38.927845 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9b0af000-ae93-4212-b13a-065b5d81f4d9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:38.929123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9b0af000-ae93-4212-b13a-065b5d81f4d9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:38.937518 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b0af000-ae93-4212-b13a-065b5d81f4d9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:38.937804 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b0af000-ae93-4212-b13a-065b5d81f4d9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:38.938461 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b0af000-ae93-4212-b13a-065b5d81f4d9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:38.939674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b0af000-ae93-4212-b13a-065b5d81f4d9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:39.090739 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9b0af000-ae93-4212-b13a-065b5d81f4d9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:39.100945 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9b0af000-ae93-4212-b13a-065b5d81f4d9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.177601 Jun 16 14:59:39.101771 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 190/384] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:38 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:39.318348 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-80c60974-c0be-44b3-b1c5-69a891adea7d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:39.321145 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-80c60974-c0be-44b3-b1c5-69a891adea7d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:39.329574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80c60974-c0be-44b3-b1c5-69a891adea7d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:39.330348 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80c60974-c0be-44b3-b1c5-69a891adea7d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:39.331507 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80c60974-c0be-44b3-b1c5-69a891adea7d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:39.344442 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80c60974-c0be-44b3-b1c5-69a891adea7d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:39.436617 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-80c60974-c0be-44b3-b1c5-69a891adea7d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:39.451696 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-80c60974-c0be-44b3-b1c5-69a891adea7d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1306 microversion: 2.1 time: 0.150125 Jun 16 14:59:39.453931 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 195/385] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:39 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1306 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:40.120103 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9c54b185-375a-4faa-a86c-0243d40606db tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:40.121477 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9c54b185-375a-4faa-a86c-0243d40606db tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:40.128468 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9c54b185-375a-4faa-a86c-0243d40606db tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:40.129262 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9c54b185-375a-4faa-a86c-0243d40606db tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:40.130109 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9c54b185-375a-4faa-a86c-0243d40606db tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:40.130508 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9c54b185-375a-4faa-a86c-0243d40606db tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:40.358824 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9c54b185-375a-4faa-a86c-0243d40606db tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:40.369012 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9c54b185-375a-4faa-a86c-0243d40606db tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.253435 Jun 16 14:59:40.379596 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 191/386] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:40 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:40.492737 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-19f2b7b8-12f0-4a5f-8e33-dcd639b2fe09 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:40.493441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-19f2b7b8-12f0-4a5f-8e33-dcd639b2fe09 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:40.500637 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-19f2b7b8-12f0-4a5f-8e33-dcd639b2fe09 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:40.501453 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-19f2b7b8-12f0-4a5f-8e33-dcd639b2fe09 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:40.502251 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-19f2b7b8-12f0-4a5f-8e33-dcd639b2fe09 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:40.502988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-19f2b7b8-12f0-4a5f-8e33-dcd639b2fe09 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:40.791708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-19f2b7b8-12f0-4a5f-8e33-dcd639b2fe09 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:40.806388 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-19f2b7b8-12f0-4a5f-8e33-dcd639b2fe09 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.317929 Jun 16 14:59:40.820732 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 196/387] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:40 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:41.386941 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5ba7fe09-2691-46df-a83c-1ffa8704d18f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:41.387652 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5ba7fe09-2691-46df-a83c-1ffa8704d18f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:41.395834 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5ba7fe09-2691-46df-a83c-1ffa8704d18f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:41.396497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5ba7fe09-2691-46df-a83c-1ffa8704d18f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:41.397843 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5ba7fe09-2691-46df-a83c-1ffa8704d18f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:41.401757 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5ba7fe09-2691-46df-a83c-1ffa8704d18f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:41.722783 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-fedb6d5f-57f8-4735-a607-591ae986ea38 req-24d314f1-dfa2-4ee3-b2be-0a5449438bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34992108-bb48-4184-88ee-43907b8b14a3", "tag": "debe1ea3-86a2-4afa-9cc5-933e034bfa9d"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:41.739420 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-fedb6d5f-57f8-4735-a607-591ae986ea38 req-24d314f1-dfa2-4ee3-b2be-0a5449438bb9 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:41.740074 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-fedb6d5f-57f8-4735-a607-591ae986ea38 req-24d314f1-dfa2-4ee3-b2be-0a5449438bb9 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:41.802237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5ba7fe09-2691-46df-a83c-1ffa8704d18f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:41.812826 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5ba7fe09-2691-46df-a83c-1ffa8704d18f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.430584 Jun 16 14:59:41.816293 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 192/388] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:41 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:41.828256 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c902d45b-ac9a-44db-a839-ea30c4b2bd02 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:41.831851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c902d45b-ac9a-44db-a839-ea30c4b2bd02 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:41.846751 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c902d45b-ac9a-44db-a839-ea30c4b2bd02 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:41.847545 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c902d45b-ac9a-44db-a839-ea30c4b2bd02 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:41.848735 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c902d45b-ac9a-44db-a839-ea30c4b2bd02 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:41.849534 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c902d45b-ac9a-44db-a839-ea30c4b2bd02 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:42.008684 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-fedb6d5f-57f8-4735-a607-591ae986ea38 req-24d314f1-dfa2-4ee3-b2be-0a5449438bb9 service nova] Creating event network-changed:debe1ea3-86a2-4afa-9cc5-933e034bfa9d for instance 34992108-bb48-4184-88ee-43907b8b14a3 on hv-cinder-83716 Jun 16 14:59:42.016136 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-fedb6d5f-57f8-4735-a607-591ae986ea38 req-24d314f1-dfa2-4ee3-b2be-0a5449438bb9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.296953 Jun 16 14:59:42.017308 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 197/389] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 14:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 14:59:42.094240 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c902d45b-ac9a-44db-a839-ea30c4b2bd02 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:42.109660 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c902d45b-ac9a-44db-a839-ea30c4b2bd02 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.284721 Jun 16 14:59:42.110478 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 193/390] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:41 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:42.834478 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a3857f96-301b-4d07-8179-288fb5912f6c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:42.836005 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a3857f96-301b-4d07-8179-288fb5912f6c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:42.844320 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a3857f96-301b-4d07-8179-288fb5912f6c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:42.844778 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a3857f96-301b-4d07-8179-288fb5912f6c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:42.845764 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a3857f96-301b-4d07-8179-288fb5912f6c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:42.846214 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a3857f96-301b-4d07-8179-288fb5912f6c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:43.071764 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a3857f96-301b-4d07-8179-288fb5912f6c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:43.089184 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a3857f96-301b-4d07-8179-288fb5912f6c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.259293 Jun 16 14:59:43.104380 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 198/391] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:42 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:43.127939 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bf47ba80-f0aa-4ff1-ae9b-bda21dff1657 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:43.129328 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bf47ba80-f0aa-4ff1-ae9b-bda21dff1657 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:43.137802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bf47ba80-f0aa-4ff1-ae9b-bda21dff1657 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:43.138552 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bf47ba80-f0aa-4ff1-ae9b-bda21dff1657 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:43.140255 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bf47ba80-f0aa-4ff1-ae9b-bda21dff1657 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:43.141501 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bf47ba80-f0aa-4ff1-ae9b-bda21dff1657 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:43.440941 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bf47ba80-f0aa-4ff1-ae9b-bda21dff1657 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:43.452717 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bf47ba80-f0aa-4ff1-ae9b-bda21dff1657 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.329277 Jun 16 14:59:43.462897 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 194/392] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:43 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:44.120046 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7aa945c2-6ea9-42aa-86dd-50accf5a4afb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:44.123127 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7aa945c2-6ea9-42aa-86dd-50accf5a4afb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:44.139692 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7aa945c2-6ea9-42aa-86dd-50accf5a4afb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:44.141070 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7aa945c2-6ea9-42aa-86dd-50accf5a4afb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:44.142364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7aa945c2-6ea9-42aa-86dd-50accf5a4afb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:44.143027 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7aa945c2-6ea9-42aa-86dd-50accf5a4afb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:44.345255 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7aa945c2-6ea9-42aa-86dd-50accf5a4afb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:44.355619 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7aa945c2-6ea9-42aa-86dd-50accf5a4afb tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.248091 Jun 16 14:59:44.367591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 199/393] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:44 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:44.484577 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3a7b24d1-2a06-418f-bb7d-55f1714bf852 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:44.487298 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3a7b24d1-2a06-418f-bb7d-55f1714bf852 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:44.507877 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3a7b24d1-2a06-418f-bb7d-55f1714bf852 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:44.508463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3a7b24d1-2a06-418f-bb7d-55f1714bf852 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:44.509629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3a7b24d1-2a06-418f-bb7d-55f1714bf852 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:44.510283 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3a7b24d1-2a06-418f-bb7d-55f1714bf852 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:44.736069 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3a7b24d1-2a06-418f-bb7d-55f1714bf852 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:44.750280 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3a7b24d1-2a06-418f-bb7d-55f1714bf852 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.280795 Jun 16 14:59:44.751484 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 195/394] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:44 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:45.373347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c0a37650-dd42-4190-8b23-af1d1d976f0c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:45.374060 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c0a37650-dd42-4190-8b23-af1d1d976f0c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:45.380784 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c0a37650-dd42-4190-8b23-af1d1d976f0c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:45.381261 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c0a37650-dd42-4190-8b23-af1d1d976f0c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:45.382536 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c0a37650-dd42-4190-8b23-af1d1d976f0c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:45.383016 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c0a37650-dd42-4190-8b23-af1d1d976f0c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:45.548586 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c0a37650-dd42-4190-8b23-af1d1d976f0c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:45.561849 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c0a37650-dd42-4190-8b23-af1d1d976f0c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.191954 Jun 16 14:59:45.563147 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 200/395] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:45 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:45.783957 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3e5566a7-993a-4fbc-a7dd-1f6f612b5758 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:45.785173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3e5566a7-993a-4fbc-a7dd-1f6f612b5758 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:45.821479 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e5566a7-993a-4fbc-a7dd-1f6f612b5758 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:45.822252 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e5566a7-993a-4fbc-a7dd-1f6f612b5758 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:45.829412 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e5566a7-993a-4fbc-a7dd-1f6f612b5758 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:45.832763 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e5566a7-993a-4fbc-a7dd-1f6f612b5758 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:46.285169 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3e5566a7-993a-4fbc-a7dd-1f6f612b5758 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:46.300467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3e5566a7-993a-4fbc-a7dd-1f6f612b5758 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.535515 Jun 16 14:59:46.304223 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 196/396] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:45 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:46.600729 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f2e86fbc-e198-4ed9-b1d8-5e2eda038895 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:46.602255 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f2e86fbc-e198-4ed9-b1d8-5e2eda038895 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:46.619889 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f2e86fbc-e198-4ed9-b1d8-5e2eda038895 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:46.620804 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f2e86fbc-e198-4ed9-b1d8-5e2eda038895 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:46.622423 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f2e86fbc-e198-4ed9-b1d8-5e2eda038895 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:46.623423 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f2e86fbc-e198-4ed9-b1d8-5e2eda038895 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:46.904709 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f2e86fbc-e198-4ed9-b1d8-5e2eda038895 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:46.914979 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f2e86fbc-e198-4ed9-b1d8-5e2eda038895 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.337826 Jun 16 14:59:46.926829 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 201/397] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:46 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:47.322675 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0526e80e-ea2a-4010-8613-b20ab9f2e69c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:47.323976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0526e80e-ea2a-4010-8613-b20ab9f2e69c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:47.330571 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:47.331595 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=10 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:47.335103 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0526e80e-ea2a-4010-8613-b20ab9f2e69c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:47.335781 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0526e80e-ea2a-4010-8613-b20ab9f2e69c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:47.337001 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0526e80e-ea2a-4010-8613-b20ab9f2e69c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:47.337618 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0526e80e-ea2a-4010-8613-b20ab9f2e69c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:47.574118 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0526e80e-ea2a-4010-8613-b20ab9f2e69c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:47.586766 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0526e80e-ea2a-4010-8613-b20ab9f2e69c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.270180 Jun 16 14:59:47.587357 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 197/398] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:47 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:47.934463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5e05caac-5eab-43c0-9c1b-6a51b29e2260 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:47.935901 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5e05caac-5eab-43c0-9c1b-6a51b29e2260 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:47.944777 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:47.947957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5e05caac-5eab-43c0-9c1b-6a51b29e2260 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:47.948617 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5e05caac-5eab-43c0-9c1b-6a51b29e2260 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:47.949837 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5e05caac-5eab-43c0-9c1b-6a51b29e2260 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:47.951087 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5e05caac-5eab-43c0-9c1b-6a51b29e2260 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:48.239333 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5e05caac-5eab-43c0-9c1b-6a51b29e2260 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:48.251754 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5e05caac-5eab-43c0-9c1b-6a51b29e2260 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.321038 Jun 16 14:59:48.252833 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 202/399] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:47 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:48.604737 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-eff43f5a-156b-44cd-b0b5-0b9baab3f876 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:48.606313 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-eff43f5a-156b-44cd-b0b5-0b9baab3f876 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:48.608936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:48.615109 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eff43f5a-156b-44cd-b0b5-0b9baab3f876 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:48.615581 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eff43f5a-156b-44cd-b0b5-0b9baab3f876 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:48.616588 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eff43f5a-156b-44cd-b0b5-0b9baab3f876 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:48.617084 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eff43f5a-156b-44cd-b0b5-0b9baab3f876 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:48.639865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:48.902514 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-eff43f5a-156b-44cd-b0b5-0b9baab3f876 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:48.913136 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-eff43f5a-156b-44cd-b0b5-0b9baab3f876 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.312615 Jun 16 14:59:48.914065 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 198/400] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:48 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:49.275872 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d4aca7c6-29f4-40d2-a82a-7968f45f1841 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:49.278379 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d4aca7c6-29f4-40d2-a82a-7968f45f1841 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:49.291931 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2dbe45ee-7398-46fe-881c-35f047f45def tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-673443453", "imageRef": "23371504-a4d6-4064-90b4-87bfd0a15170", "flavorRef": "452", "networks": [{"uuid": "07db0cfb-ec4f-4004-a40d-4f4a390f3311"}]}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:49.295788 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d4aca7c6-29f4-40d2-a82a-7968f45f1841 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:49.296268 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d4aca7c6-29f4-40d2-a82a-7968f45f1841 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:49.297148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d4aca7c6-29f4-40d2-a82a-7968f45f1841 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:49.297579 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d4aca7c6-29f4-40d2-a82a-7968f45f1841 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:49.395857 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-2dbe45ee-7398-46fe-881c-35f047f45def tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] validate_networks() for [('07db0cfb-ec4f-4004-a40d-4f4a390f3311', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 14:59:49.479199 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d4aca7c6-29f4-40d2-a82a-7968f45f1841 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:49.493484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d4aca7c6-29f4-40d2-a82a-7968f45f1841 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.225443 Jun 16 14:59:49.494417 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 203/401] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:49 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:49.934223 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b14dd905-245e-492e-8e1a-d9f7bf45f881 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:49.934901 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b14dd905-245e-492e-8e1a-d9f7bf45f881 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:49.941877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b14dd905-245e-492e-8e1a-d9f7bf45f881 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:49.942324 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b14dd905-245e-492e-8e1a-d9f7bf45f881 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:49.943094 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b14dd905-245e-492e-8e1a-d9f7bf45f881 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:49.943532 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b14dd905-245e-492e-8e1a-d9f7bf45f881 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:49.970694 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-2dbe45ee-7398-46fe-881c-35f047f45def tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 14:59:49.971429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-2dbe45ee-7398-46fe-881c-35f047f45def tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 14:59:49.972642 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-2dbe45ee-7398-46fe-881c-35f047f45def tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 14:59:49.973852 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-2dbe45ee-7398-46fe-881c-35f047f45def tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 14:59:49.974522 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-2dbe45ee-7398-46fe-881c-35f047f45def tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 14:59:49.996622 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2dbe45ee-7398-46fe-881c-35f047f45def tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:49.997192 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2dbe45ee-7398-46fe-881c-35f047f45def tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:49.998534 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2dbe45ee-7398-46fe-881c-35f047f45def tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:49.999143 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2dbe45ee-7398-46fe-881c-35f047f45def tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:50.029234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-2dbe45ee-7398-46fe-881c-35f047f45def tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Getting quotas for project 8bfa0f9f3251447c922938888ddea917. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:59:50.035938 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-2dbe45ee-7398-46fe-881c-35f047f45def tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Getting quotas for user aab9d86304804cb189c0c1d065d7e7b1 and project 8bfa0f9f3251447c922938888ddea917. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:59:50.056051 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2dbe45ee-7398-46fe-881c-35f047f45def tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 14:59:50.058256 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2dbe45ee-7398-46fe-881c-35f047f45def tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23371504-a4d6-4064-90b4-87bfd0a15170',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 14:59:50.112909 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2dbe45ee-7398-46fe-881c-35f047f45def tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.826361 Jun 16 14:59:50.113894 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 199/402] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 14:59:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 14:59:50.126187 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-064f9e8c-5bc2-43f0-a2c2-123758982ef5 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:50.127283 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-064f9e8c-5bc2-43f0-a2c2-123758982ef5 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:50.270369 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b14dd905-245e-492e-8e1a-d9f7bf45f881 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:50.274360 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-064f9e8c-5bc2-43f0-a2c2-123758982ef5 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:50.282623 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b14dd905-245e-492e-8e1a-d9f7bf45f881 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.352828 Jun 16 14:59:50.292010 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 204/403] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:49 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:50.294074 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-064f9e8c-5bc2-43f0-a2c2-123758982ef5 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1213 microversion: 2.1 time: 0.172807 Jun 16 14:59:50.295727 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 200/404] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:50 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1213 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:50.523452 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f3aa1aa1-7616-4a91-806a-13c4812a2759 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:50.524139 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f3aa1aa1-7616-4a91-806a-13c4812a2759 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:50.531078 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f3aa1aa1-7616-4a91-806a-13c4812a2759 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:50.531888 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f3aa1aa1-7616-4a91-806a-13c4812a2759 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:50.532703 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f3aa1aa1-7616-4a91-806a-13c4812a2759 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:50.538173 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f3aa1aa1-7616-4a91-806a-13c4812a2759 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:50.812408 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f3aa1aa1-7616-4a91-806a-13c4812a2759 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:50.826333 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f3aa1aa1-7616-4a91-806a-13c4812a2759 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.314969 Jun 16 14:59:50.826924 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 205/405] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:50 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:51.300962 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9b0ba4d0-18ef-48a9-81e7-0f0a93dee0dd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:51.303236 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9b0ba4d0-18ef-48a9-81e7-0f0a93dee0dd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:51.314206 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f69f22a6-fadd-4969-8ea9-f218f3e5ef27 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:51.316225 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f69f22a6-fadd-4969-8ea9-f218f3e5ef27 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:51.327911 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b0ba4d0-18ef-48a9-81e7-0f0a93dee0dd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:51.330070 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f69f22a6-fadd-4969-8ea9-f218f3e5ef27 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:51.331757 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b0ba4d0-18ef-48a9-81e7-0f0a93dee0dd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:51.332147 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f69f22a6-fadd-4969-8ea9-f218f3e5ef27 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:51.333482 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f69f22a6-fadd-4969-8ea9-f218f3e5ef27 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:51.340976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b0ba4d0-18ef-48a9-81e7-0f0a93dee0dd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:51.340976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b0ba4d0-18ef-48a9-81e7-0f0a93dee0dd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:51.341338 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f69f22a6-fadd-4969-8ea9-f218f3e5ef27 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:51.484977 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f69f22a6-fadd-4969-8ea9-f218f3e5ef27 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:51.503523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f69f22a6-fadd-4969-8ea9-f218f3e5ef27 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1217 microversion: 2.1 time: 0.194599 Jun 16 14:59:51.504105 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 206/406] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:51 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1217 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:51.580010 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9b0ba4d0-18ef-48a9-81e7-0f0a93dee0dd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:51.612735 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9b0ba4d0-18ef-48a9-81e7-0f0a93dee0dd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.304860 Jun 16 14:59:51.614768 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 201/407] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:51 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:51.846009 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8be76cee-47d9-47ca-9cae-59f03803d5cd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:51.847102 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8be76cee-47d9-47ca-9cae-59f03803d5cd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:51.855787 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8be76cee-47d9-47ca-9cae-59f03803d5cd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:51.856690 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8be76cee-47d9-47ca-9cae-59f03803d5cd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:51.857736 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8be76cee-47d9-47ca-9cae-59f03803d5cd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:51.858397 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8be76cee-47d9-47ca-9cae-59f03803d5cd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:52.084268 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8be76cee-47d9-47ca-9cae-59f03803d5cd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:52.091171 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 14:59:52.098983 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8be76cee-47d9-47ca-9cae-59f03803d5cd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.256908 Jun 16 14:59:52.099879 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 207/408] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:51 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:52.522853 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9460f71d-d7f2-4b68-943b-28b944701a40 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:52.524441 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9460f71d-d7f2-4b68-943b-28b944701a40 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:52.532525 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9460f71d-d7f2-4b68-943b-28b944701a40 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:52.537598 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9460f71d-d7f2-4b68-943b-28b944701a40 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:52.545197 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9460f71d-d7f2-4b68-943b-28b944701a40 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:52.545814 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9460f71d-d7f2-4b68-943b-28b944701a40 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:52.638127 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-07e8aa9f-3184-42cf-939c-ba4e9be732ec tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:52.639405 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-07e8aa9f-3184-42cf-939c-ba4e9be732ec tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:52.655918 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-07e8aa9f-3184-42cf-939c-ba4e9be732ec tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:52.656669 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-07e8aa9f-3184-42cf-939c-ba4e9be732ec tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:52.657653 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-07e8aa9f-3184-42cf-939c-ba4e9be732ec tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:52.658252 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-07e8aa9f-3184-42cf-939c-ba4e9be732ec tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:52.722313 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9460f71d-d7f2-4b68-943b-28b944701a40 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:52.734254 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9460f71d-d7f2-4b68-943b-28b944701a40 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1217 microversion: 2.1 time: 0.215668 Jun 16 14:59:52.736555 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 202/409] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:52 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1217 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:52.940183 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-07e8aa9f-3184-42cf-939c-ba4e9be732ec tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:52.953817 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-07e8aa9f-3184-42cf-939c-ba4e9be732ec tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.320067 Jun 16 14:59:52.964658 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 208/410] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:52 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 14:59:53.118847 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d55651e0-867d-40d7-bd83-10e2ffa7cfd5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:53.120433 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d55651e0-867d-40d7-bd83-10e2ffa7cfd5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:53.127143 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d55651e0-867d-40d7-bd83-10e2ffa7cfd5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:53.127892 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d55651e0-867d-40d7-bd83-10e2ffa7cfd5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:53.129089 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d55651e0-867d-40d7-bd83-10e2ffa7cfd5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:53.129695 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d55651e0-867d-40d7-bd83-10e2ffa7cfd5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:53.496514 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d55651e0-867d-40d7-bd83-10e2ffa7cfd5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:53.507698 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d55651e0-867d-40d7-bd83-10e2ffa7cfd5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.395669 Jun 16 14:59:53.508607 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 203/411] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:53 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:53.755843 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d65569c2-a4ff-48b2-baff-b4439498c6ef tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:53.759535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d65569c2-a4ff-48b2-baff-b4439498c6ef tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:53.776400 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d65569c2-a4ff-48b2-baff-b4439498c6ef tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:53.780852 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d65569c2-a4ff-48b2-baff-b4439498c6ef tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:53.782791 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d65569c2-a4ff-48b2-baff-b4439498c6ef tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:53.783440 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d65569c2-a4ff-48b2-baff-b4439498c6ef tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:53.916354 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d65569c2-a4ff-48b2-baff-b4439498c6ef tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:53.926198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d65569c2-a4ff-48b2-baff-b4439498c6ef tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1217 microversion: 2.1 time: 0.178244 Jun 16 14:59:53.927138 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 209/412] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:53 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1217 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:53.972825 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9a0ff758-490c-4038-a60d-235ccc2c2d90 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:53.974101 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9a0ff758-490c-4038-a60d-235ccc2c2d90 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:53.985261 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9a0ff758-490c-4038-a60d-235ccc2c2d90 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:53.986099 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9a0ff758-490c-4038-a60d-235ccc2c2d90 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:53.987246 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9a0ff758-490c-4038-a60d-235ccc2c2d90 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:53.987955 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9a0ff758-490c-4038-a60d-235ccc2c2d90 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:54.291859 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9a0ff758-490c-4038-a60d-235ccc2c2d90 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:54.305143 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9a0ff758-490c-4038-a60d-235ccc2c2d90 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.336408 Jun 16 14:59:54.306784 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 204/413] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:53 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:54.526990 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f3321306-f788-4767-9ae8-800b1254aa04 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:54.527966 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f3321306-f788-4767-9ae8-800b1254aa04 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:54.544771 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f3321306-f788-4767-9ae8-800b1254aa04 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:54.545242 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f3321306-f788-4767-9ae8-800b1254aa04 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:54.546290 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f3321306-f788-4767-9ae8-800b1254aa04 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:54.546458 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f3321306-f788-4767-9ae8-800b1254aa04 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:54.849372 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f3321306-f788-4767-9ae8-800b1254aa04 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:54.867260 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f3321306-f788-4767-9ae8-800b1254aa04 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.343909 Jun 16 14:59:54.868228 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 210/414] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:54 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:54.947839 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2dc40009-aa5d-4fdc-b72e-f55249f8085c tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:54.949107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2dc40009-aa5d-4fdc-b72e-f55249f8085c tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:54.956490 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2dc40009-aa5d-4fdc-b72e-f55249f8085c tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:54.957670 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2dc40009-aa5d-4fdc-b72e-f55249f8085c tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:54.958498 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2dc40009-aa5d-4fdc-b72e-f55249f8085c tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:54.960040 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2dc40009-aa5d-4fdc-b72e-f55249f8085c tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:55.188564 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2dc40009-aa5d-4fdc-b72e-f55249f8085c tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:55.199707 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2dc40009-aa5d-4fdc-b72e-f55249f8085c tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1209 microversion: 2.1 time: 0.259587 Jun 16 14:59:55.200659 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 205/415] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:54 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1209 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:55.325901 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-13ee53d5-157c-48f5-b7c2-6634846e330e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:55.327196 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-13ee53d5-157c-48f5-b7c2-6634846e330e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:55.334854 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-13ee53d5-157c-48f5-b7c2-6634846e330e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:55.335689 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-13ee53d5-157c-48f5-b7c2-6634846e330e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:55.337556 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-13ee53d5-157c-48f5-b7c2-6634846e330e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:55.338220 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-13ee53d5-157c-48f5-b7c2-6634846e330e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:55.548899 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-13ee53d5-157c-48f5-b7c2-6634846e330e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:55.559038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-13ee53d5-157c-48f5-b7c2-6634846e330e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.239282 Jun 16 14:59:55.559145 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 211/416] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:55 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:55.772715 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-da11d128-e980-4b96-95eb-b8827d6a983b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Action: 'create', calling method: .version_select at 0x7faab643f790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1659470293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDN5qZp3Ms3NteelP4wKitdHZu6yjywDiqG087paa58fH0+lSvUIwuFtSSPu/GGK//sbBCK+HcvciI50FM0lBx00MlPFB864LTkcvbKUD/XnxeKDy2Z32Q9KAu5zVPoWNA=="}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 14:59:55.803880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-da11d128-e980-4b96-95eb-b8827d6a983b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Getting quotas for project 05223500b4a142c7a77c2de010541b84. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 14:59:55.808303 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-da11d128-e980-4b96-95eb-b8827d6a983b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Getting quotas for user 9d977f609537476daa8fe8adbab9ff9c and project 05223500b4a142c7a77c2de010541b84. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 14:59:55.841709 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-da11d128-e980-4b96-95eb-b8827d6a983b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.415258 Jun 16 14:59:55.857329 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 206/417] 10.222.0.72 () {60 vars in 1158 bytes} [Thu Jun 16 14:59:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 14:59:55.887856 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fba3164d-87c7-46e9-91ac-569bf0fa49d0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:55.888638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fba3164d-87c7-46e9-91ac-569bf0fa49d0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:55.895711 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fba3164d-87c7-46e9-91ac-569bf0fa49d0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:55.896170 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fba3164d-87c7-46e9-91ac-569bf0fa49d0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:55.897005 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fba3164d-87c7-46e9-91ac-569bf0fa49d0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:55.897448 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fba3164d-87c7-46e9-91ac-569bf0fa49d0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:56.147623 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fba3164d-87c7-46e9-91ac-569bf0fa49d0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:56.158922 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fba3164d-87c7-46e9-91ac-569bf0fa49d0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.277590 Jun 16 14:59:56.161395 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 212/418] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:55 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:56.217513 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b14018a9-f342-482e-9e39-4fa0ecf156b0 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:56.218815 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b14018a9-f342-482e-9e39-4fa0ecf156b0 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:56.226435 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b14018a9-f342-482e-9e39-4fa0ecf156b0 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:56.228576 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b14018a9-f342-482e-9e39-4fa0ecf156b0 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:56.229629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b14018a9-f342-482e-9e39-4fa0ecf156b0 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:56.230238 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b14018a9-f342-482e-9e39-4fa0ecf156b0 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:56.340996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b14018a9-f342-482e-9e39-4fa0ecf156b0 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:56.353881 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b14018a9-f342-482e-9e39-4fa0ecf156b0 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1265 microversion: 2.1 time: 0.140528 Jun 16 14:59:56.354859 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 207/419] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:56 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1265 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:56.576280 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f231ffe0-c141-4bae-9a63-b68620d08d2e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:56.576995 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f231ffe0-c141-4bae-9a63-b68620d08d2e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:56.583517 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f231ffe0-c141-4bae-9a63-b68620d08d2e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:56.584046 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f231ffe0-c141-4bae-9a63-b68620d08d2e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:56.585507 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f231ffe0-c141-4bae-9a63-b68620d08d2e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:56.586008 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f231ffe0-c141-4bae-9a63-b68620d08d2e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:56.759152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f231ffe0-c141-4bae-9a63-b68620d08d2e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:56.771205 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f231ffe0-c141-4bae-9a63-b68620d08d2e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.198835 Jun 16 14:59:56.782442 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 213/420] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:56 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:57.180450 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-48f4b1fc-f07a-4f52-b23c-ce1e4a5b52ca tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:57.181105 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-48f4b1fc-f07a-4f52-b23c-ce1e4a5b52ca tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:57.191113 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-48f4b1fc-f07a-4f52-b23c-ce1e4a5b52ca tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:57.191762 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-48f4b1fc-f07a-4f52-b23c-ce1e4a5b52ca tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:57.192578 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-48f4b1fc-f07a-4f52-b23c-ce1e4a5b52ca tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:57.193183 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-48f4b1fc-f07a-4f52-b23c-ce1e4a5b52ca tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:57.371791 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5089637b-5c4b-4bbf-a90d-f3af2ddfea1a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:57.372412 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5089637b-5c4b-4bbf-a90d-f3af2ddfea1a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:57.379411 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5089637b-5c4b-4bbf-a90d-f3af2ddfea1a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:57.380000 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5089637b-5c4b-4bbf-a90d-f3af2ddfea1a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:57.380936 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5089637b-5c4b-4bbf-a90d-f3af2ddfea1a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:57.381764 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5089637b-5c4b-4bbf-a90d-f3af2ddfea1a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:57.408378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-48f4b1fc-f07a-4f52-b23c-ce1e4a5b52ca tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:57.421387 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-48f4b1fc-f07a-4f52-b23c-ce1e4a5b52ca tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.245289 Jun 16 14:59:57.430637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 208/421] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:57 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:57.483448 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5089637b-5c4b-4bbf-a90d-f3af2ddfea1a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:57.493166 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5089637b-5c4b-4bbf-a90d-f3af2ddfea1a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1265 microversion: 2.1 time: 0.126021 Jun 16 14:59:57.494007 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 214/422] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:57 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1265 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:57.789935 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b7cd2fcc-08cf-4518-97d5-ce0676d1a20a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:57.790554 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b7cd2fcc-08cf-4518-97d5-ce0676d1a20a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:57.798209 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b7cd2fcc-08cf-4518-97d5-ce0676d1a20a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:57.798741 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b7cd2fcc-08cf-4518-97d5-ce0676d1a20a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:57.799777 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b7cd2fcc-08cf-4518-97d5-ce0676d1a20a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:57.800229 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b7cd2fcc-08cf-4518-97d5-ce0676d1a20a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:57.977537 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b7cd2fcc-08cf-4518-97d5-ce0676d1a20a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:57.986812 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b7cd2fcc-08cf-4518-97d5-ce0676d1a20a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.201306 Jun 16 14:59:57.987830 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 209/423] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:57 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:58.439456 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-24e4e4b2-735e-4449-8d1e-ed7ca0cf054b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:58.440048 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-24e4e4b2-735e-4449-8d1e-ed7ca0cf054b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:58.446905 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-24e4e4b2-735e-4449-8d1e-ed7ca0cf054b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:58.447508 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-24e4e4b2-735e-4449-8d1e-ed7ca0cf054b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:58.448580 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-24e4e4b2-735e-4449-8d1e-ed7ca0cf054b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:58.448990 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-24e4e4b2-735e-4449-8d1e-ed7ca0cf054b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:58.517187 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fd114f5a-ab66-4871-aa12-1188c190fe79 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:58.518101 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fd114f5a-ab66-4871-aa12-1188c190fe79 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:58.526106 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fd114f5a-ab66-4871-aa12-1188c190fe79 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:58.526568 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fd114f5a-ab66-4871-aa12-1188c190fe79 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:58.527341 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fd114f5a-ab66-4871-aa12-1188c190fe79 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:58.527776 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fd114f5a-ab66-4871-aa12-1188c190fe79 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:58.611963 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-fd114f5a-ab66-4871-aa12-1188c190fe79 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:58.624675 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-24e4e4b2-735e-4449-8d1e-ed7ca0cf054b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:58.630463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fd114f5a-ab66-4871-aa12-1188c190fe79 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1265 microversion: 2.1 time: 0.121978 Jun 16 14:59:58.635383 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 210/424] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:58 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1265 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:58.640147 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-24e4e4b2-735e-4449-8d1e-ed7ca0cf054b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.204200 Jun 16 14:59:58.644225 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 215/425] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:58 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:59.009607 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-54e08d6c-5f03-4a86-b9f6-6fc7c6d60ca3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:59.010222 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-54e08d6c-5f03-4a86-b9f6-6fc7c6d60ca3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:59.017194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-54e08d6c-5f03-4a86-b9f6-6fc7c6d60ca3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:59.017646 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-54e08d6c-5f03-4a86-b9f6-6fc7c6d60ca3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:59.018829 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-54e08d6c-5f03-4a86-b9f6-6fc7c6d60ca3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:59.019500 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-54e08d6c-5f03-4a86-b9f6-6fc7c6d60ca3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:59.225024 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-54e08d6c-5f03-4a86-b9f6-6fc7c6d60ca3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:59.234562 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-54e08d6c-5f03-4a86-b9f6-6fc7c6d60ca3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.229202 Jun 16 14:59:59.235275 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 211/426] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:59 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:59.648401 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e63a9e92-eb67-4374-9685-5d5b9494c7ab tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:59.649118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e63a9e92-eb67-4374-9685-5d5b9494c7ab tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:59.657356 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e63a9e92-eb67-4374-9685-5d5b9494c7ab tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:59.657948 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e63a9e92-eb67-4374-9685-5d5b9494c7ab tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:59.658719 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e63a9e92-eb67-4374-9685-5d5b9494c7ab tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:59.659192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e63a9e92-eb67-4374-9685-5d5b9494c7ab tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:59.662020 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1fdb9151-ebb0-4189-8b68-a4b1817b3aee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 14:59:59.663587 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1fdb9151-ebb0-4189-8b68-a4b1817b3aee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 14:59:59.673927 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fdb9151-ebb0-4189-8b68-a4b1817b3aee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:59.674481 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fdb9151-ebb0-4189-8b68-a4b1817b3aee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:59.675220 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fdb9151-ebb0-4189-8b68-a4b1817b3aee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 14:59:59.675665 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fdb9151-ebb0-4189-8b68-a4b1817b3aee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 14:59:59.737593 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e63a9e92-eb67-4374-9685-5d5b9494c7ab tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:59.748829 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e63a9e92-eb67-4374-9685-5d5b9494c7ab tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1265 microversion: 2.1 time: 0.104861 Jun 16 14:59:59.758206 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 216/427] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:59 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1265 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 14:59:59.857415 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1fdb9151-ebb0-4189-8b68-a4b1817b3aee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 14:59:59.868455 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1fdb9151-ebb0-4189-8b68-a4b1817b3aee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.212051 Jun 16 14:59:59.869358 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 212/428] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 14:59:59 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:00.252725 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4858885b-6d32-4b41-b7bb-b5ff2dfd6da5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:00.253771 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4858885b-6d32-4b41-b7bb-b5ff2dfd6da5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:00.260342 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4858885b-6d32-4b41-b7bb-b5ff2dfd6da5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:00.261120 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4858885b-6d32-4b41-b7bb-b5ff2dfd6da5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:00.262050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4858885b-6d32-4b41-b7bb-b5ff2dfd6da5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:00.262584 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4858885b-6d32-4b41-b7bb-b5ff2dfd6da5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:00.416826 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4858885b-6d32-4b41-b7bb-b5ff2dfd6da5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:00.425199 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4858885b-6d32-4b41-b7bb-b5ff2dfd6da5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.176446 Jun 16 15:00:00.425789 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 217/429] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:00 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:00.765947 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-36b16616-d40b-4cfa-992f-15a58557ec04 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:00.766711 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-36b16616-d40b-4cfa-992f-15a58557ec04 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:00.768755 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:00.782599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-36b16616-d40b-4cfa-992f-15a58557ec04 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:00.783869 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-36b16616-d40b-4cfa-992f-15a58557ec04 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:00.785262 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-36b16616-d40b-4cfa-992f-15a58557ec04 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:00.790682 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-36b16616-d40b-4cfa-992f-15a58557ec04 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:00.895494 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5b188227-883a-4f8b-be20-1cacd0400f9c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:00.896306 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5b188227-883a-4f8b-be20-1cacd0400f9c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:00.899941 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=61 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:00.916209 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5b188227-883a-4f8b-be20-1cacd0400f9c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:00.916657 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5b188227-883a-4f8b-be20-1cacd0400f9c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:00.917571 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5b188227-883a-4f8b-be20-1cacd0400f9c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:00.918009 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5b188227-883a-4f8b-be20-1cacd0400f9c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:00.940155 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-36b16616-d40b-4cfa-992f-15a58557ec04 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:00.966293 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-36b16616-d40b-4cfa-992f-15a58557ec04 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1265 microversion: 2.1 time: 0.204015 Jun 16 15:00:00.966886 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 213/430] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:00 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:01.246566 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5b188227-883a-4f8b-be20-1cacd0400f9c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:01.258502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5b188227-883a-4f8b-be20-1cacd0400f9c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1522 microversion: 2.1 time: 0.367905 Jun 16 15:00:01.259638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 218/431] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:00 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1522 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:01.443231 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6a71a14b-bbcd-4497-8db4-51cf800caf5c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:01.443938 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6a71a14b-bbcd-4497-8db4-51cf800caf5c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:01.453628 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6a71a14b-bbcd-4497-8db4-51cf800caf5c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:01.454775 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6a71a14b-bbcd-4497-8db4-51cf800caf5c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:01.455829 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6a71a14b-bbcd-4497-8db4-51cf800caf5c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:01.456517 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6a71a14b-bbcd-4497-8db4-51cf800caf5c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:01.636118 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6a71a14b-bbcd-4497-8db4-51cf800caf5c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:01.645129 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6a71a14b-bbcd-4497-8db4-51cf800caf5c tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.205579 Jun 16 15:00:01.645826 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 214/432] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:01 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:01.985829 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b7b37ffb-a39b-4c6c-9ff8-2d09689ea18a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:01.986598 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b7b37ffb-a39b-4c6c-9ff8-2d09689ea18a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:01.995427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b7b37ffb-a39b-4c6c-9ff8-2d09689ea18a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:01.995976 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b7b37ffb-a39b-4c6c-9ff8-2d09689ea18a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:01.996952 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b7b37ffb-a39b-4c6c-9ff8-2d09689ea18a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:01.997496 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b7b37ffb-a39b-4c6c-9ff8-2d09689ea18a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:02.078373 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b7b37ffb-a39b-4c6c-9ff8-2d09689ea18a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:02.087023 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b7b37ffb-a39b-4c6c-9ff8-2d09689ea18a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1265 microversion: 2.1 time: 0.106271 Jun 16 15:00:02.087989 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 219/433] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:01 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:02.278337 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-99277aa7-3e32-4bfd-bd84-6153e9bec037 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:02.280191 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-99277aa7-3e32-4bfd-bd84-6153e9bec037 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:02.304593 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-99277aa7-3e32-4bfd-bd84-6153e9bec037 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:02.305173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-99277aa7-3e32-4bfd-bd84-6153e9bec037 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:02.306032 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-99277aa7-3e32-4bfd-bd84-6153e9bec037 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:02.306585 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-99277aa7-3e32-4bfd-bd84-6153e9bec037 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:02.484433 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-99277aa7-3e32-4bfd-bd84-6153e9bec037 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:02.494097 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-99277aa7-3e32-4bfd-bd84-6153e9bec037 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1502 microversion: 2.1 time: 0.220843 Jun 16 15:00:02.494687 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 215/434] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:02 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1502 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:02.510733 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7bc8a762-acda-4035-acd1-223624f785de tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:02.511339 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7bc8a762-acda-4035-acd1-223624f785de tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:02.518591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7bc8a762-acda-4035-acd1-223624f785de tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:02.519169 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7bc8a762-acda-4035-acd1-223624f785de tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:02.519808 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7bc8a762-acda-4035-acd1-223624f785de tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:02.520242 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7bc8a762-acda-4035-acd1-223624f785de tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:02.666247 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c98a8417-fe54-4682-8d90-62e32ba66941 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:02.666871 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c98a8417-fe54-4682-8d90-62e32ba66941 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:02.669986 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7bc8a762-acda-4035-acd1-223624f785de tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:02.674312 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c98a8417-fe54-4682-8d90-62e32ba66941 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:02.674770 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c98a8417-fe54-4682-8d90-62e32ba66941 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:02.675581 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c98a8417-fe54-4682-8d90-62e32ba66941 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:02.676016 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c98a8417-fe54-4682-8d90-62e32ba66941 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:02.679530 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7bc8a762-acda-4035-acd1-223624f785de tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1515 microversion: 2.1 time: 0.173093 Jun 16 15:00:02.680500 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 220/435] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:02 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:02.850233 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c98a8417-fe54-4682-8d90-62e32ba66941 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:02.858082 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c98a8417-fe54-4682-8d90-62e32ba66941 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.198250 Jun 16 15:00:02.858653 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 216/436] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:02 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:03.109377 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9234b30a-29f7-4eda-b256-8360a482e403 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:03.109891 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9234b30a-29f7-4eda-b256-8360a482e403 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:03.123358 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9234b30a-29f7-4eda-b256-8360a482e403 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:03.123822 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9234b30a-29f7-4eda-b256-8360a482e403 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:03.124630 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9234b30a-29f7-4eda-b256-8360a482e403 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:03.125105 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9234b30a-29f7-4eda-b256-8360a482e403 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:03.218660 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9234b30a-29f7-4eda-b256-8360a482e403 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:03.230655 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9234b30a-29f7-4eda-b256-8360a482e403 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1283 microversion: 2.1 time: 0.128070 Jun 16 15:00:03.231808 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 221/437] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:03 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1283 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:03.892063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-89b90129-cba8-4b67-b645-99f1e2ab64f3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:03.893119 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-89b90129-cba8-4b67-b645-99f1e2ab64f3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:03.902018 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-89b90129-cba8-4b67-b645-99f1e2ab64f3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:03.902319 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-89b90129-cba8-4b67-b645-99f1e2ab64f3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:03.903556 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-89b90129-cba8-4b67-b645-99f1e2ab64f3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:03.903998 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-89b90129-cba8-4b67-b645-99f1e2ab64f3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:04.122857 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-89b90129-cba8-4b67-b645-99f1e2ab64f3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:04.126616 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:04.132096 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-89b90129-cba8-4b67-b645-99f1e2ab64f3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.259223 Jun 16 15:00:04.132684 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 217/438] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:03 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:04.249027 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-50dadb42-771a-4631-9f43-bce84babd453 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:04.249641 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-50dadb42-771a-4631-9f43-bce84babd453 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:04.256199 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-50dadb42-771a-4631-9f43-bce84babd453 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:04.256741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-50dadb42-771a-4631-9f43-bce84babd453 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:04.257664 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-50dadb42-771a-4631-9f43-bce84babd453 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:04.258098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-50dadb42-771a-4631-9f43-bce84babd453 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:04.411736 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-50dadb42-771a-4631-9f43-bce84babd453 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:04.425014 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-50dadb42-771a-4631-9f43-bce84babd453 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1313 microversion: 2.1 time: 0.180087 Jun 16 15:00:04.426029 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 222/439] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:04 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:04.737908 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-896845a3-f2ed-4f48-819f-d64394315d32 req-a24aebe8-5018-4f9f-a98c-34dfc864ebbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03533502-cce0-4b66-a223-974d7c2d69e3", "tag": "007d803c-5b61-4f7b-85da-08d5f1236816"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:04.749162 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-896845a3-f2ed-4f48-819f-d64394315d32 req-a24aebe8-5018-4f9f-a98c-34dfc864ebbe service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:04.749732 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-896845a3-f2ed-4f48-819f-d64394315d32 req-a24aebe8-5018-4f9f-a98c-34dfc864ebbe service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:04.762723 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-896845a3-f2ed-4f48-819f-d64394315d32 req-a24aebe8-5018-4f9f-a98c-34dfc864ebbe service nova] Creating event network-changed:007d803c-5b61-4f7b-85da-08d5f1236816 for instance 03533502-cce0-4b66-a223-974d7c2d69e3 on hv-cinder-83716 Jun 16 15:00:04.769042 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-896845a3-f2ed-4f48-819f-d64394315d32 req-a24aebe8-5018-4f9f-a98c-34dfc864ebbe service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038736 Jun 16 15:00:04.770276 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 218/440] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:05.151777 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ed837381-e6ac-45bd-9b9b-347894e59806 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:05.152532 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ed837381-e6ac-45bd-9b9b-347894e59806 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:05.159558 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed837381-e6ac-45bd-9b9b-347894e59806 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:05.160324 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed837381-e6ac-45bd-9b9b-347894e59806 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:05.161150 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed837381-e6ac-45bd-9b9b-347894e59806 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:05.161589 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed837381-e6ac-45bd-9b9b-347894e59806 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:05.263083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-cc1a4fea-7320-4eef-91fc-0795ea780d1c req-ba014342-cfb3-4657-82de-6f705da8e4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34992108-bb48-4184-88ee-43907b8b14a3", "name": "network-vif-plugged", "status": "completed", "tag": "debe1ea3-86a2-4afa-9cc5-933e034bfa9d"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:05.274894 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-cc1a4fea-7320-4eef-91fc-0795ea780d1c req-ba014342-cfb3-4657-82de-6f705da8e4f8 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:05.276887 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-cc1a4fea-7320-4eef-91fc-0795ea780d1c req-ba014342-cfb3-4657-82de-6f705da8e4f8 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:05.297253 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-cc1a4fea-7320-4eef-91fc-0795ea780d1c req-ba014342-cfb3-4657-82de-6f705da8e4f8 service nova] Creating event network-vif-plugged:debe1ea3-86a2-4afa-9cc5-933e034bfa9d for instance 34992108-bb48-4184-88ee-43907b8b14a3 on hv-cinder-83716 Jun 16 15:00:05.306260 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-cc1a4fea-7320-4eef-91fc-0795ea780d1c req-ba014342-cfb3-4657-82de-6f705da8e4f8 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048557 Jun 16 15:00:05.307351 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 219/441] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:05.313769 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0891804d-077a-4bdc-ad40-6ea47d659fe3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:05.314893 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0891804d-077a-4bdc-ad40-6ea47d659fe3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:05.322440 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0891804d-077a-4bdc-ad40-6ea47d659fe3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:05.322992 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0891804d-077a-4bdc-ad40-6ea47d659fe3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:05.324209 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0891804d-077a-4bdc-ad40-6ea47d659fe3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:05.324737 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0891804d-077a-4bdc-ad40-6ea47d659fe3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:05.366692 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-0891804d-077a-4bdc-ad40-6ea47d659fe3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lazy-loading 'flavor' on Instance uuid 822acf52-490b-49b9-b85f-db02cc41a0bf {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:00:05.373766 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ed837381-e6ac-45bd-9b9b-347894e59806 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:05.384673 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ed837381-e6ac-45bd-9b9b-347894e59806 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.238148 Jun 16 15:00:05.385726 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 223/442] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:05 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:05.445930 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b4ca590f-9691-4ab5-86e8-e936a995d4e1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:05.447703 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b4ca590f-9691-4ab5-86e8-e936a995d4e1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:05.456333 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b4ca590f-9691-4ab5-86e8-e936a995d4e1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:05.456971 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b4ca590f-9691-4ab5-86e8-e936a995d4e1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:05.458118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b4ca590f-9691-4ab5-86e8-e936a995d4e1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:05.458423 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b4ca590f-9691-4ab5-86e8-e936a995d4e1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:05.473201 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0891804d-077a-4bdc-ad40-6ea47d659fe3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "POST /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf/action" status: 200 len: 32 microversion: 2.1 time: 0.163963 Jun 16 15:00:05.474110 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 220/443] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Jun 16 15:00:05 2022] POST /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf/action => generated 32 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 15:00:05.488611 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0ba509dc-1cc4-470d-9ed4-5990eef2bbe3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:05.489756 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0ba509dc-1cc4-470d-9ed4-5990eef2bbe3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:05.497639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0ba509dc-1cc4-470d-9ed4-5990eef2bbe3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:05.498462 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0ba509dc-1cc4-470d-9ed4-5990eef2bbe3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:05.499899 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0ba509dc-1cc4-470d-9ed4-5990eef2bbe3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:05.500354 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0ba509dc-1cc4-470d-9ed4-5990eef2bbe3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:05.502190 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:05.699909 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b4ca590f-9691-4ab5-86e8-e936a995d4e1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:05.707875 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b4ca590f-9691-4ab5-86e8-e936a995d4e1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1313 microversion: 2.1 time: 0.269270 Jun 16 15:00:05.708501 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 224/444] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:05 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:05.816609 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=12 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:05.996823 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0ba509dc-1cc4-470d-9ed4-5990eef2bbe3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:06.006780 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0ba509dc-1cc4-470d-9ed4-5990eef2bbe3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.523072 Jun 16 15:00:06.007370 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 221/445] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:05 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:06.405298 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-75c64b63-9e07-4091-a4ac-e87233a2ce29 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:06.405899 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-75c64b63-9e07-4091-a4ac-e87233a2ce29 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:06.412947 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75c64b63-9e07-4091-a4ac-e87233a2ce29 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:06.413520 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75c64b63-9e07-4091-a4ac-e87233a2ce29 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:06.414514 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75c64b63-9e07-4091-a4ac-e87233a2ce29 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:06.415042 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75c64b63-9e07-4091-a4ac-e87233a2ce29 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:06.561147 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-75c64b63-9e07-4091-a4ac-e87233a2ce29 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:06.569649 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-75c64b63-9e07-4091-a4ac-e87233a2ce29 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.168931 Jun 16 15:00:06.570229 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 225/446] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:06 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:06.729477 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5b0d69ff-58f5-49b7-8a17-0bdecb5b3dae tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:06.730238 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5b0d69ff-58f5-49b7-8a17-0bdecb5b3dae tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:06.737646 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5b0d69ff-58f5-49b7-8a17-0bdecb5b3dae tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:06.738106 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5b0d69ff-58f5-49b7-8a17-0bdecb5b3dae tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:06.738895 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5b0d69ff-58f5-49b7-8a17-0bdecb5b3dae tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:06.739339 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5b0d69ff-58f5-49b7-8a17-0bdecb5b3dae tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:06.923417 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5b0d69ff-58f5-49b7-8a17-0bdecb5b3dae tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:06.932047 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5b0d69ff-58f5-49b7-8a17-0bdecb5b3dae tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1313 microversion: 2.1 time: 0.210254 Jun 16 15:00:06.932752 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 222/447] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:06 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:07.026117 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-322d5ac3-6ca2-4052-8b1c-b06f6cbb621e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:07.027063 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-322d5ac3-6ca2-4052-8b1c-b06f6cbb621e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:07.033657 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-322d5ac3-6ca2-4052-8b1c-b06f6cbb621e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:07.034112 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-322d5ac3-6ca2-4052-8b1c-b06f6cbb621e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:07.034902 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-322d5ac3-6ca2-4052-8b1c-b06f6cbb621e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:07.035340 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-322d5ac3-6ca2-4052-8b1c-b06f6cbb621e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:07.194316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-322d5ac3-6ca2-4052-8b1c-b06f6cbb621e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:07.202592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-322d5ac3-6ca2-4052-8b1c-b06f6cbb621e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.180923 Jun 16 15:00:07.203166 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 226/448] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:07 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:07.586221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5a226d5b-8193-422e-ad33-4301bdf1ae4e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:07.586864 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5a226d5b-8193-422e-ad33-4301bdf1ae4e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:07.593097 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5a226d5b-8193-422e-ad33-4301bdf1ae4e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:07.593571 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5a226d5b-8193-422e-ad33-4301bdf1ae4e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:07.594333 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5a226d5b-8193-422e-ad33-4301bdf1ae4e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:07.594778 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5a226d5b-8193-422e-ad33-4301bdf1ae4e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:07.736543 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5a226d5b-8193-422e-ad33-4301bdf1ae4e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:07.744407 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5a226d5b-8193-422e-ad33-4301bdf1ae4e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.162453 Jun 16 15:00:07.745271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 223/449] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:07 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:07.953240 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fbb37be9-480e-4fd3-8d75-8377ad0b3802 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:07.954347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fbb37be9-480e-4fd3-8d75-8377ad0b3802 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:07.963357 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fbb37be9-480e-4fd3-8d75-8377ad0b3802 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:07.963813 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fbb37be9-480e-4fd3-8d75-8377ad0b3802 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:07.964584 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fbb37be9-480e-4fd3-8d75-8377ad0b3802 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:07.965062 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fbb37be9-480e-4fd3-8d75-8377ad0b3802 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:08.121826 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fbb37be9-480e-4fd3-8d75-8377ad0b3802 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:08.129826 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fbb37be9-480e-4fd3-8d75-8377ad0b3802 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1313 microversion: 2.1 time: 0.183236 Jun 16 15:00:08.130733 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 227/450] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:07 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:08.220619 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1fc62f60-4576-4f79-a4a7-fafab3b5c27c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:08.221179 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1fc62f60-4576-4f79-a4a7-fafab3b5c27c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:08.227857 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fc62f60-4576-4f79-a4a7-fafab3b5c27c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:08.228316 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fc62f60-4576-4f79-a4a7-fafab3b5c27c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:08.229120 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fc62f60-4576-4f79-a4a7-fafab3b5c27c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:08.229562 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fc62f60-4576-4f79-a4a7-fafab3b5c27c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:08.384139 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1fc62f60-4576-4f79-a4a7-fafab3b5c27c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:08.392004 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1fc62f60-4576-4f79-a4a7-fafab3b5c27c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.175262 Jun 16 15:00:08.392603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 224/451] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:08 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:08.761654 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-73d6a6f1-4b0d-4c12-9f3d-fa0bad0114b1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:08.762258 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-73d6a6f1-4b0d-4c12-9f3d-fa0bad0114b1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:08.768516 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-73d6a6f1-4b0d-4c12-9f3d-fa0bad0114b1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:08.769324 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-73d6a6f1-4b0d-4c12-9f3d-fa0bad0114b1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:08.770627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-73d6a6f1-4b0d-4c12-9f3d-fa0bad0114b1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:08.772013 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-73d6a6f1-4b0d-4c12-9f3d-fa0bad0114b1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:08.934569 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-73d6a6f1-4b0d-4c12-9f3d-fa0bad0114b1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:08.942509 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-73d6a6f1-4b0d-4c12-9f3d-fa0bad0114b1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.184707 Jun 16 15:00:08.943082 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 228/452] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:08 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:09.149412 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4783ef61-6ef3-450a-9f1c-2d45467e05a7 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:09.150015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4783ef61-6ef3-450a-9f1c-2d45467e05a7 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:09.157226 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4783ef61-6ef3-450a-9f1c-2d45467e05a7 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:09.157681 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4783ef61-6ef3-450a-9f1c-2d45467e05a7 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:09.158455 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4783ef61-6ef3-450a-9f1c-2d45467e05a7 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:09.158899 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4783ef61-6ef3-450a-9f1c-2d45467e05a7 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:09.296314 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4783ef61-6ef3-450a-9f1c-2d45467e05a7 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:09.306387 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4783ef61-6ef3-450a-9f1c-2d45467e05a7 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1313 microversion: 2.1 time: 0.161241 Jun 16 15:00:09.307062 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 225/453] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:09 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:09.413635 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-859ba0e5-d418-4a24-9aa8-8ecee25e8893 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:09.414315 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-859ba0e5-d418-4a24-9aa8-8ecee25e8893 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:09.420599 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-859ba0e5-d418-4a24-9aa8-8ecee25e8893 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:09.421107 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-859ba0e5-d418-4a24-9aa8-8ecee25e8893 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:09.421877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-859ba0e5-d418-4a24-9aa8-8ecee25e8893 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:09.422315 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-859ba0e5-d418-4a24-9aa8-8ecee25e8893 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:09.561427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-859ba0e5-d418-4a24-9aa8-8ecee25e8893 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:09.569654 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-859ba0e5-d418-4a24-9aa8-8ecee25e8893 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.161706 Jun 16 15:00:09.570259 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 229/454] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:09 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:09.966321 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ac2d1f1b-35ed-48e3-a581-a92ee546d8c6 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:09.966926 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ac2d1f1b-35ed-48e3-a581-a92ee546d8c6 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:09.973275 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ac2d1f1b-35ed-48e3-a581-a92ee546d8c6 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:09.973730 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ac2d1f1b-35ed-48e3-a581-a92ee546d8c6 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:09.974506 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ac2d1f1b-35ed-48e3-a581-a92ee546d8c6 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:09.974943 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ac2d1f1b-35ed-48e3-a581-a92ee546d8c6 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:10.109643 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ac2d1f1b-35ed-48e3-a581-a92ee546d8c6 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:10.117629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ac2d1f1b-35ed-48e3-a581-a92ee546d8c6 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.155062 Jun 16 15:00:10.118215 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 226/455] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:09 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:10.324604 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d023e827-a68b-4912-9171-db450f9fc4b6 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:10.325239 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d023e827-a68b-4912-9171-db450f9fc4b6 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:10.331531 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d023e827-a68b-4912-9171-db450f9fc4b6 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:10.331977 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d023e827-a68b-4912-9171-db450f9fc4b6 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:10.332747 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d023e827-a68b-4912-9171-db450f9fc4b6 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:10.333228 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d023e827-a68b-4912-9171-db450f9fc4b6 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:10.494630 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d023e827-a68b-4912-9171-db450f9fc4b6 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:10.502510 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d023e827-a68b-4912-9171-db450f9fc4b6 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1313 microversion: 2.1 time: 0.182057 Jun 16 15:00:10.503088 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 230/456] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:10 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:10.586570 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-eb47fb16-fed6-4c5e-98b3-ad3e6d974a7f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:10.587206 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-eb47fb16-fed6-4c5e-98b3-ad3e6d974a7f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:10.594060 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eb47fb16-fed6-4c5e-98b3-ad3e6d974a7f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:10.594509 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eb47fb16-fed6-4c5e-98b3-ad3e6d974a7f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:10.595287 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eb47fb16-fed6-4c5e-98b3-ad3e6d974a7f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:10.595725 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eb47fb16-fed6-4c5e-98b3-ad3e6d974a7f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:10.758574 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-eb47fb16-fed6-4c5e-98b3-ad3e6d974a7f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:10.766951 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-eb47fb16-fed6-4c5e-98b3-ad3e6d974a7f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.184795 Jun 16 15:00:10.767547 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 227/457] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:10 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:11.134760 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ddbbf6d2-e92c-4982-be65-156f637c69f9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:11.135411 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ddbbf6d2-e92c-4982-be65-156f637c69f9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:11.141763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddbbf6d2-e92c-4982-be65-156f637c69f9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:11.142253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddbbf6d2-e92c-4982-be65-156f637c69f9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:11.143024 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddbbf6d2-e92c-4982-be65-156f637c69f9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:11.143464 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddbbf6d2-e92c-4982-be65-156f637c69f9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:11.291369 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ddbbf6d2-e92c-4982-be65-156f637c69f9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:11.301139 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ddbbf6d2-e92c-4982-be65-156f637c69f9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.170128 Jun 16 15:00:11.301792 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 231/458] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:11 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:11.519306 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5b9c6a1e-7617-4a97-bc40-180c9c135fb1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:11.519840 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5b9c6a1e-7617-4a97-bc40-180c9c135fb1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:11.526891 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5b9c6a1e-7617-4a97-bc40-180c9c135fb1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:11.527347 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5b9c6a1e-7617-4a97-bc40-180c9c135fb1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:11.528134 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5b9c6a1e-7617-4a97-bc40-180c9c135fb1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:11.528914 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5b9c6a1e-7617-4a97-bc40-180c9c135fb1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:11.664856 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5b9c6a1e-7617-4a97-bc40-180c9c135fb1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:11.673559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5b9c6a1e-7617-4a97-bc40-180c9c135fb1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1313 microversion: 2.1 time: 0.158253 Jun 16 15:00:11.674151 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 228/459] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:11 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:11.787670 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1f8537f5-6271-420e-b8c0-b118861abe65 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:11.788448 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1f8537f5-6271-420e-b8c0-b118861abe65 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:11.794667 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1f8537f5-6271-420e-b8c0-b118861abe65 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:11.795111 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1f8537f5-6271-420e-b8c0-b118861abe65 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:11.796008 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1f8537f5-6271-420e-b8c0-b118861abe65 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:11.796557 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1f8537f5-6271-420e-b8c0-b118861abe65 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:11.941884 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1f8537f5-6271-420e-b8c0-b118861abe65 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:11.949802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1f8537f5-6271-420e-b8c0-b118861abe65 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.167173 Jun 16 15:00:11.950379 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 232/460] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:11 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:12.318011 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-23a35720-6a3f-4a37-a7a9-724e9ce044c2 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:12.318733 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-23a35720-6a3f-4a37-a7a9-724e9ce044c2 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:12.327497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-23a35720-6a3f-4a37-a7a9-724e9ce044c2 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:12.327951 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-23a35720-6a3f-4a37-a7a9-724e9ce044c2 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:12.328746 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-23a35720-6a3f-4a37-a7a9-724e9ce044c2 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:12.329362 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-23a35720-6a3f-4a37-a7a9-724e9ce044c2 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:12.479284 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-23a35720-6a3f-4a37-a7a9-724e9ce044c2 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:12.488442 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-23a35720-6a3f-4a37-a7a9-724e9ce044c2 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.174293 Jun 16 15:00:12.489330 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 229/461] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:12 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:12.691845 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fc6dfe39-7578-4d2a-9717-9efab7dbf73a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:12.692356 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fc6dfe39-7578-4d2a-9717-9efab7dbf73a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:12.698645 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fc6dfe39-7578-4d2a-9717-9efab7dbf73a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:12.699098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fc6dfe39-7578-4d2a-9717-9efab7dbf73a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:12.699838 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fc6dfe39-7578-4d2a-9717-9efab7dbf73a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:12.700264 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fc6dfe39-7578-4d2a-9717-9efab7dbf73a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:12.851344 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fc6dfe39-7578-4d2a-9717-9efab7dbf73a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:12.859182 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fc6dfe39-7578-4d2a-9717-9efab7dbf73a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1313 microversion: 2.1 time: 0.171259 Jun 16 15:00:12.859765 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 233/462] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:12 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:12.967746 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4c66ce68-e702-44a5-a478-fa9b65dc5dad tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:12.968351 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4c66ce68-e702-44a5-a478-fa9b65dc5dad tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:12.975726 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4c66ce68-e702-44a5-a478-fa9b65dc5dad tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:12.976180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4c66ce68-e702-44a5-a478-fa9b65dc5dad tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:12.976997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4c66ce68-e702-44a5-a478-fa9b65dc5dad tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:12.977442 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4c66ce68-e702-44a5-a478-fa9b65dc5dad tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:13.139970 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4c66ce68-e702-44a5-a478-fa9b65dc5dad tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:13.147801 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4c66ce68-e702-44a5-a478-fa9b65dc5dad tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.184058 Jun 16 15:00:13.148378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 230/463] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:12 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:13.507070 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f26f9abd-da90-4c70-ba6d-80119ad455cf tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:13.507684 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f26f9abd-da90-4c70-ba6d-80119ad455cf tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:13.514097 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f26f9abd-da90-4c70-ba6d-80119ad455cf tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:13.514691 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f26f9abd-da90-4c70-ba6d-80119ad455cf tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:13.515530 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f26f9abd-da90-4c70-ba6d-80119ad455cf tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:13.515968 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f26f9abd-da90-4c70-ba6d-80119ad455cf tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:13.654679 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f26f9abd-da90-4c70-ba6d-80119ad455cf tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:13.663088 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f26f9abd-da90-4c70-ba6d-80119ad455cf tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.159883 Jun 16 15:00:13.663653 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 234/464] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:13 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:13.875865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bac75ce4-24af-421c-b04b-fd4af313d83b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:13.876396 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bac75ce4-24af-421c-b04b-fd4af313d83b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:13.886720 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bac75ce4-24af-421c-b04b-fd4af313d83b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:13.887630 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bac75ce4-24af-421c-b04b-fd4af313d83b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:13.888578 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bac75ce4-24af-421c-b04b-fd4af313d83b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:13.889260 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bac75ce4-24af-421c-b04b-fd4af313d83b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:14.034595 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bac75ce4-24af-421c-b04b-fd4af313d83b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:14.042997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bac75ce4-24af-421c-b04b-fd4af313d83b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1313 microversion: 2.1 time: 0.171124 Jun 16 15:00:14.043559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 231/465] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:13 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:14.165193 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b88aff88-2cb2-45f9-a27f-ae7c6a8d292a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:14.165779 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b88aff88-2cb2-45f9-a27f-ae7c6a8d292a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:14.172006 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b88aff88-2cb2-45f9-a27f-ae7c6a8d292a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:14.172459 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b88aff88-2cb2-45f9-a27f-ae7c6a8d292a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:14.173275 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b88aff88-2cb2-45f9-a27f-ae7c6a8d292a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:14.173714 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b88aff88-2cb2-45f9-a27f-ae7c6a8d292a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:14.310469 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b88aff88-2cb2-45f9-a27f-ae7c6a8d292a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:14.318484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b88aff88-2cb2-45f9-a27f-ae7c6a8d292a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.157842 Jun 16 15:00:14.319080 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 235/466] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:14 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:14.680399 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ae5163e9-0fed-4d9b-8cee-9064e2324c67 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:14.681045 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ae5163e9-0fed-4d9b-8cee-9064e2324c67 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:14.687297 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ae5163e9-0fed-4d9b-8cee-9064e2324c67 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:14.687753 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ae5163e9-0fed-4d9b-8cee-9064e2324c67 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:14.688603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ae5163e9-0fed-4d9b-8cee-9064e2324c67 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:14.689038 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ae5163e9-0fed-4d9b-8cee-9064e2324c67 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:14.823874 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ae5163e9-0fed-4d9b-8cee-9064e2324c67 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:14.831913 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ae5163e9-0fed-4d9b-8cee-9064e2324c67 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.155977 Jun 16 15:00:14.832478 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 232/467] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:14 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:15.059551 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-22f60657-d2f9-4a37-85e2-63958d04f2a8 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:15.060174 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-22f60657-d2f9-4a37-85e2-63958d04f2a8 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:15.066488 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-22f60657-d2f9-4a37-85e2-63958d04f2a8 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:15.066923 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-22f60657-d2f9-4a37-85e2-63958d04f2a8 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:15.067684 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-22f60657-d2f9-4a37-85e2-63958d04f2a8 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:15.068116 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-22f60657-d2f9-4a37-85e2-63958d04f2a8 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:15.221070 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-22f60657-d2f9-4a37-85e2-63958d04f2a8 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:15.228625 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-22f60657-d2f9-4a37-85e2-63958d04f2a8 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1313 microversion: 2.1 time: 0.172923 Jun 16 15:00:15.229218 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 236/468] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:15 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:15.336666 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4f67c1e6-cb3c-4f42-8374-50f3f7379382 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:15.337330 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4f67c1e6-cb3c-4f42-8374-50f3f7379382 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:15.343978 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f67c1e6-cb3c-4f42-8374-50f3f7379382 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:15.344435 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f67c1e6-cb3c-4f42-8374-50f3f7379382 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:15.345258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f67c1e6-cb3c-4f42-8374-50f3f7379382 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:15.345704 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f67c1e6-cb3c-4f42-8374-50f3f7379382 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:15.512495 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4f67c1e6-cb3c-4f42-8374-50f3f7379382 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:15.515935 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:15.522003 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4f67c1e6-cb3c-4f42-8374-50f3f7379382 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.189238 Jun 16 15:00:15.522606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 233/469] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:15 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:15.851780 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a300d8ca-e660-4269-9ae9-a657d9901d30 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:15.852424 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a300d8ca-e660-4269-9ae9-a657d9901d30 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:15.858751 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a300d8ca-e660-4269-9ae9-a657d9901d30 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:15.859197 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a300d8ca-e660-4269-9ae9-a657d9901d30 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:15.859962 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a300d8ca-e660-4269-9ae9-a657d9901d30 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:15.860395 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a300d8ca-e660-4269-9ae9-a657d9901d30 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:15.992363 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a300d8ca-e660-4269-9ae9-a657d9901d30 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:15.999944 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a300d8ca-e660-4269-9ae9-a657d9901d30 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.153696 Jun 16 15:00:16.000501 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 237/470] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:15 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:16.245888 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b25af659-ac07-4bc8-b960-6d0fc3796d3b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:16.246494 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b25af659-ac07-4bc8-b960-6d0fc3796d3b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:16.253882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b25af659-ac07-4bc8-b960-6d0fc3796d3b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:16.254324 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b25af659-ac07-4bc8-b960-6d0fc3796d3b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:16.255078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b25af659-ac07-4bc8-b960-6d0fc3796d3b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:16.255509 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b25af659-ac07-4bc8-b960-6d0fc3796d3b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:16.391554 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b25af659-ac07-4bc8-b960-6d0fc3796d3b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:16.399601 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b25af659-ac07-4bc8-b960-6d0fc3796d3b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1313 microversion: 2.1 time: 0.157548 Jun 16 15:00:16.400160 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 234/471] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:16 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:16.539962 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2efafafd-2422-4d56-b8bc-6d8c9acd42d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:16.540695 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2efafafd-2422-4d56-b8bc-6d8c9acd42d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:16.546810 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2efafafd-2422-4d56-b8bc-6d8c9acd42d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:16.547251 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2efafafd-2422-4d56-b8bc-6d8c9acd42d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:16.547999 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2efafafd-2422-4d56-b8bc-6d8c9acd42d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:16.548421 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2efafafd-2422-4d56-b8bc-6d8c9acd42d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:16.683801 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2efafafd-2422-4d56-b8bc-6d8c9acd42d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:16.691806 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2efafafd-2422-4d56-b8bc-6d8c9acd42d2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.156222 Jun 16 15:00:16.692377 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 238/472] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:16 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:17.020022 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-667f1682-389b-4e4e-a74a-8db784007171 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:17.020312 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-667f1682-389b-4e4e-a74a-8db784007171 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:17.024573 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:17.029857 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-667f1682-389b-4e4e-a74a-8db784007171 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:17.030497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-667f1682-389b-4e4e-a74a-8db784007171 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:17.032116 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-667f1682-389b-4e4e-a74a-8db784007171 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:17.032497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-667f1682-389b-4e4e-a74a-8db784007171 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:17.180312 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-667f1682-389b-4e4e-a74a-8db784007171 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:17.193793 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-667f1682-389b-4e4e-a74a-8db784007171 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.180400 Jun 16 15:00:17.194386 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 235/473] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:17 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:17.416756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-cecb8a4e-f37b-49d5-8cff-6a42ab9a5180 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:17.417398 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-cecb8a4e-f37b-49d5-8cff-6a42ab9a5180 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:17.423718 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cecb8a4e-f37b-49d5-8cff-6a42ab9a5180 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:17.424165 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cecb8a4e-f37b-49d5-8cff-6a42ab9a5180 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:17.424971 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cecb8a4e-f37b-49d5-8cff-6a42ab9a5180 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:17.425523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cecb8a4e-f37b-49d5-8cff-6a42ab9a5180 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:17.567015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-cecb8a4e-f37b-49d5-8cff-6a42ab9a5180 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:17.576593 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-cecb8a4e-f37b-49d5-8cff-6a42ab9a5180 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1313 microversion: 2.1 time: 0.163632 Jun 16 15:00:17.577387 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 239/474] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:17 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:17.710608 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-82895032-96ed-4f96-beb9-d679ad443666 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:17.711160 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-82895032-96ed-4f96-beb9-d679ad443666 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:17.717719 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82895032-96ed-4f96-beb9-d679ad443666 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:17.718170 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82895032-96ed-4f96-beb9-d679ad443666 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:17.718938 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82895032-96ed-4f96-beb9-d679ad443666 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:17.719377 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82895032-96ed-4f96-beb9-d679ad443666 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:17.855508 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-82895032-96ed-4f96-beb9-d679ad443666 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:17.863339 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-82895032-96ed-4f96-beb9-d679ad443666 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.157667 Jun 16 15:00:17.863918 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 236/475] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:17 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:18.210961 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d351a8ae-b9df-45e7-a7ac-9a436c9f17b0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:18.211560 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d351a8ae-b9df-45e7-a7ac-9a436c9f17b0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:18.217680 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d351a8ae-b9df-45e7-a7ac-9a436c9f17b0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:18.218124 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d351a8ae-b9df-45e7-a7ac-9a436c9f17b0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:18.218869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d351a8ae-b9df-45e7-a7ac-9a436c9f17b0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:18.219295 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d351a8ae-b9df-45e7-a7ac-9a436c9f17b0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:18.355836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d351a8ae-b9df-45e7-a7ac-9a436c9f17b0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:18.363742 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d351a8ae-b9df-45e7-a7ac-9a436c9f17b0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.156640 Jun 16 15:00:18.364318 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 240/476] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:18 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:18.593149 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-322e50a3-38b4-4dfc-b737-05ae4a6b9280 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:18.593766 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-322e50a3-38b4-4dfc-b737-05ae4a6b9280 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:18.600544 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-322e50a3-38b4-4dfc-b737-05ae4a6b9280 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:18.601024 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-322e50a3-38b4-4dfc-b737-05ae4a6b9280 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:18.601791 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-322e50a3-38b4-4dfc-b737-05ae4a6b9280 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:18.602223 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-322e50a3-38b4-4dfc-b737-05ae4a6b9280 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:18.732631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-322e50a3-38b4-4dfc-b737-05ae4a6b9280 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:18.740153 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-322e50a3-38b4-4dfc-b737-05ae4a6b9280 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1313 microversion: 2.1 time: 0.150717 Jun 16 15:00:18.740722 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 237/477] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:18 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:18.884262 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3037d493-15ae-4352-a9c6-3cdedce3ed06 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:18.884947 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3037d493-15ae-4352-a9c6-3cdedce3ed06 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:18.891124 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3037d493-15ae-4352-a9c6-3cdedce3ed06 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:18.891614 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3037d493-15ae-4352-a9c6-3cdedce3ed06 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:18.892458 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3037d493-15ae-4352-a9c6-3cdedce3ed06 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:18.892939 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3037d493-15ae-4352-a9c6-3cdedce3ed06 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:18.897696 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:19.033301 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3037d493-15ae-4352-a9c6-3cdedce3ed06 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:19.041001 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3037d493-15ae-4352-a9c6-3cdedce3ed06 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.161271 Jun 16 15:00:19.041564 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 241/478] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:18 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:19.381281 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5f9e0af7-09cc-4d3e-bdfb-b62027217681 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:19.381900 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5f9e0af7-09cc-4d3e-bdfb-b62027217681 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:19.387955 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f9e0af7-09cc-4d3e-bdfb-b62027217681 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:19.388410 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f9e0af7-09cc-4d3e-bdfb-b62027217681 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:19.389202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f9e0af7-09cc-4d3e-bdfb-b62027217681 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:19.389642 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f9e0af7-09cc-4d3e-bdfb-b62027217681 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:19.527217 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5f9e0af7-09cc-4d3e-bdfb-b62027217681 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:19.542579 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5f9e0af7-09cc-4d3e-bdfb-b62027217681 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.165067 Jun 16 15:00:19.543167 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 238/479] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:19 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:19.757613 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-474cc768-ff25-4304-8099-5f28ddedb2d8 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:19.758215 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-474cc768-ff25-4304-8099-5f28ddedb2d8 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:19.764307 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-474cc768-ff25-4304-8099-5f28ddedb2d8 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:19.764728 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-474cc768-ff25-4304-8099-5f28ddedb2d8 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:19.765521 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-474cc768-ff25-4304-8099-5f28ddedb2d8 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:19.765952 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-474cc768-ff25-4304-8099-5f28ddedb2d8 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:19.898256 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-474cc768-ff25-4304-8099-5f28ddedb2d8 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:19.905902 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-474cc768-ff25-4304-8099-5f28ddedb2d8 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1313 microversion: 2.1 time: 0.152660 Jun 16 15:00:19.906446 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 242/480] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:19 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:20.057287 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-04cf53fc-5c33-4955-b82d-de90fa0abea5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:20.057902 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-04cf53fc-5c33-4955-b82d-de90fa0abea5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:20.064450 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-04cf53fc-5c33-4955-b82d-de90fa0abea5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:20.064934 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-04cf53fc-5c33-4955-b82d-de90fa0abea5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:20.065704 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-04cf53fc-5c33-4955-b82d-de90fa0abea5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:20.066148 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-04cf53fc-5c33-4955-b82d-de90fa0abea5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:20.201224 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-04cf53fc-5c33-4955-b82d-de90fa0abea5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:20.209264 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-04cf53fc-5c33-4955-b82d-de90fa0abea5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.155264 Jun 16 15:00:20.209826 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 239/481] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:20 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:20.560006 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8a6c4953-38f2-432f-8110-c7d824f854b3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:20.560642 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8a6c4953-38f2-432f-8110-c7d824f854b3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:20.566769 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a6c4953-38f2-432f-8110-c7d824f854b3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:20.567252 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a6c4953-38f2-432f-8110-c7d824f854b3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:20.568029 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a6c4953-38f2-432f-8110-c7d824f854b3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:20.568464 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a6c4953-38f2-432f-8110-c7d824f854b3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:20.710819 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8a6c4953-38f2-432f-8110-c7d824f854b3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:20.724056 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8a6c4953-38f2-432f-8110-c7d824f854b3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1361 microversion: 2.1 time: 0.167730 Jun 16 15:00:20.734774 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 243/482] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:20 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:20.922875 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fa643e7b-14fc-42e7-943d-3145e1d22e21 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:20.923510 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fa643e7b-14fc-42e7-943d-3145e1d22e21 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:20.931857 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fa643e7b-14fc-42e7-943d-3145e1d22e21 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:20.932493 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fa643e7b-14fc-42e7-943d-3145e1d22e21 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:20.933682 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fa643e7b-14fc-42e7-943d-3145e1d22e21 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:20.934181 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fa643e7b-14fc-42e7-943d-3145e1d22e21 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:21.066225 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-fa643e7b-14fc-42e7-943d-3145e1d22e21 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:21.074345 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fa643e7b-14fc-42e7-943d-3145e1d22e21 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1313 microversion: 2.1 time: 0.155288 Jun 16 15:00:21.074913 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 240/483] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:20 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:21.226862 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e2edc881-265d-409d-ad90-1138eca0aa01 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:21.227570 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e2edc881-265d-409d-ad90-1138eca0aa01 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:21.237268 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e2edc881-265d-409d-ad90-1138eca0aa01 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:21.238109 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e2edc881-265d-409d-ad90-1138eca0aa01 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:21.239476 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e2edc881-265d-409d-ad90-1138eca0aa01 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:21.240823 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e2edc881-265d-409d-ad90-1138eca0aa01 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:21.410038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e2edc881-265d-409d-ad90-1138eca0aa01 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:21.418329 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e2edc881-265d-409d-ad90-1138eca0aa01 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.195850 Jun 16 15:00:21.418906 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 244/484] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:21 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:21.742208 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c48b67d0-4941-442c-b115-13f60a418f35 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:21.743151 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c48b67d0-4941-442c-b115-13f60a418f35 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:21.749781 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c48b67d0-4941-442c-b115-13f60a418f35 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:21.750233 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c48b67d0-4941-442c-b115-13f60a418f35 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:21.751027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c48b67d0-4941-442c-b115-13f60a418f35 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:21.751461 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c48b67d0-4941-442c-b115-13f60a418f35 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:21.986152 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c48b67d0-4941-442c-b115-13f60a418f35 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:21.996148 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c48b67d0-4941-442c-b115-13f60a418f35 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1547 microversion: 2.1 time: 0.257773 Jun 16 15:00:21.997067 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 241/485] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:21 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1547 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:22.012856 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-344e63ca-d2c4-4343-a349-5cebb0082040 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:22.013657 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-344e63ca-d2c4-4343-a349-5cebb0082040 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:22.019747 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-344e63ca-d2c4-4343-a349-5cebb0082040 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:22.020201 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-344e63ca-d2c4-4343-a349-5cebb0082040 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:22.020989 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-344e63ca-d2c4-4343-a349-5cebb0082040 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:22.021988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-344e63ca-d2c4-4343-a349-5cebb0082040 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:22.091769 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bc763971-7966-494c-bc53-cfe63dac008c tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:22.092575 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bc763971-7966-494c-bc53-cfe63dac008c tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:22.099113 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc763971-7966-494c-bc53-cfe63dac008c tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:22.099837 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc763971-7966-494c-bc53-cfe63dac008c tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:22.100773 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc763971-7966-494c-bc53-cfe63dac008c tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:22.101391 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc763971-7966-494c-bc53-cfe63dac008c tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:22.114348 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-344e63ca-d2c4-4343-a349-5cebb0082040 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105392 Jun 16 15:00:22.120598 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 245/486] 10.222.0.72 () {58 vars in 1274 bytes} [Thu Jun 16 15:00:22 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:00:22.435642 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-75e69435-3928-4d19-8339-bb6731b226c0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:22.436351 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-75e69435-3928-4d19-8339-bb6731b226c0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:22.443616 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75e69435-3928-4d19-8339-bb6731b226c0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:22.444089 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75e69435-3928-4d19-8339-bb6731b226c0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:22.444884 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75e69435-3928-4d19-8339-bb6731b226c0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:22.445330 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75e69435-3928-4d19-8339-bb6731b226c0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:22.555110 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bc763971-7966-494c-bc53-cfe63dac008c tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:22.563856 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bc763971-7966-494c-bc53-cfe63dac008c tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1313 microversion: 2.1 time: 0.476571 Jun 16 15:00:22.574188 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 242/487] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:22 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:22.671468 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-75e69435-3928-4d19-8339-bb6731b226c0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:22.679592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-75e69435-3928-4d19-8339-bb6731b226c0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.247884 Jun 16 15:00:22.680151 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 246/488] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:22 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:23.151374 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-d2031b5b-8903-43af-b5a9-9d6c7b7c046f req-a3ee83a1-636a-489c-a2d0-2f3e84d6fa05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34992108-bb48-4184-88ee-43907b8b14a3", "tag": "debe1ea3-86a2-4afa-9cc5-933e034bfa9d"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:23.160345 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-d2031b5b-8903-43af-b5a9-9d6c7b7c046f req-a3ee83a1-636a-489c-a2d0-2f3e84d6fa05 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:23.160789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-d2031b5b-8903-43af-b5a9-9d6c7b7c046f req-a3ee83a1-636a-489c-a2d0-2f3e84d6fa05 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:23.172666 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-d2031b5b-8903-43af-b5a9-9d6c7b7c046f req-a3ee83a1-636a-489c-a2d0-2f3e84d6fa05 service nova] Creating event network-changed:debe1ea3-86a2-4afa-9cc5-933e034bfa9d for instance 34992108-bb48-4184-88ee-43907b8b14a3 on hv-cinder-83716 Jun 16 15:00:23.178137 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-d2031b5b-8903-43af-b5a9-9d6c7b7c046f req-a3ee83a1-636a-489c-a2d0-2f3e84d6fa05 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030259 Jun 16 15:00:23.178837 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 243/489] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:23.582202 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7d2a4609-3c60-456e-b7b4-2a8be2187e99 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:23.583485 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7d2a4609-3c60-456e-b7b4-2a8be2187e99 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:23.593065 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7d2a4609-3c60-456e-b7b4-2a8be2187e99 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:23.593811 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7d2a4609-3c60-456e-b7b4-2a8be2187e99 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:23.595437 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7d2a4609-3c60-456e-b7b4-2a8be2187e99 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:23.596099 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7d2a4609-3c60-456e-b7b4-2a8be2187e99 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:23.698233 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2a26af7a-0f58-44fe-aa99-f448ea9cbe22 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:23.699303 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2a26af7a-0f58-44fe-aa99-f448ea9cbe22 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:23.706876 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a26af7a-0f58-44fe-aa99-f448ea9cbe22 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:23.707689 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a26af7a-0f58-44fe-aa99-f448ea9cbe22 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:23.709288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a26af7a-0f58-44fe-aa99-f448ea9cbe22 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:23.709962 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a26af7a-0f58-44fe-aa99-f448ea9cbe22 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:23.758689 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7d2a4609-3c60-456e-b7b4-2a8be2187e99 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:23.766231 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7d2a4609-3c60-456e-b7b4-2a8be2187e99 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1313 microversion: 2.1 time: 0.189249 Jun 16 15:00:23.767129 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 247/490] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:23 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:23.980246 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2a26af7a-0f58-44fe-aa99-f448ea9cbe22 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:23.989238 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2a26af7a-0f58-44fe-aa99-f448ea9cbe22 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.295062 Jun 16 15:00:23.991160 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 244/491] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:23 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:24.240877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-f683896e-1366-4372-953f-379ea318b50e req-515fa0fc-2ddb-4097-9652-4bc6b4f27faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03533502-cce0-4b66-a223-974d7c2d69e3", "name": "network-vif-plugged", "status": "completed", "tag": "007d803c-5b61-4f7b-85da-08d5f1236816"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:24.255277 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-f683896e-1366-4372-953f-379ea318b50e req-515fa0fc-2ddb-4097-9652-4bc6b4f27faa service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:24.256265 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-f683896e-1366-4372-953f-379ea318b50e req-515fa0fc-2ddb-4097-9652-4bc6b4f27faa service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:24.275514 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-f683896e-1366-4372-953f-379ea318b50e req-515fa0fc-2ddb-4097-9652-4bc6b4f27faa service nova] Creating event network-vif-plugged:007d803c-5b61-4f7b-85da-08d5f1236816 for instance 03533502-cce0-4b66-a223-974d7c2d69e3 on hv-cinder-83716 Jun 16 15:00:24.282505 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-f683896e-1366-4372-953f-379ea318b50e req-515fa0fc-2ddb-4097-9652-4bc6b4f27faa service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045773 Jun 16 15:00:24.283401 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 248/492] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:24.783282 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6877e024-5cb9-498a-a378-74658693e594 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:24.784027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6877e024-5cb9-498a-a378-74658693e594 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:24.791259 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6877e024-5cb9-498a-a378-74658693e594 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:24.791795 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6877e024-5cb9-498a-a378-74658693e594 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:24.792640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6877e024-5cb9-498a-a378-74658693e594 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:24.793376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6877e024-5cb9-498a-a378-74658693e594 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:24.926386 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6877e024-5cb9-498a-a378-74658693e594 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:24.934274 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6877e024-5cb9-498a-a378-74658693e594 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1313 microversion: 2.1 time: 0.154756 Jun 16 15:00:24.934833 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 245/493] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:24 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:25.007401 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e80f6523-eaeb-47cf-b527-c3e842cfee6e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:25.008580 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e80f6523-eaeb-47cf-b527-c3e842cfee6e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:25.015459 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e80f6523-eaeb-47cf-b527-c3e842cfee6e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:25.015982 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e80f6523-eaeb-47cf-b527-c3e842cfee6e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:25.016883 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e80f6523-eaeb-47cf-b527-c3e842cfee6e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:25.017366 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e80f6523-eaeb-47cf-b527-c3e842cfee6e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:25.163875 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e80f6523-eaeb-47cf-b527-c3e842cfee6e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:25.171277 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e80f6523-eaeb-47cf-b527-c3e842cfee6e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.168545 Jun 16 15:00:25.171849 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 249/494] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:25 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:25.951875 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f372e7c5-2b4d-4f3a-8e4c-3235b06ce2af tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:25.952472 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f372e7c5-2b4d-4f3a-8e4c-3235b06ce2af tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:25.959098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f372e7c5-2b4d-4f3a-8e4c-3235b06ce2af tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:25.959557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f372e7c5-2b4d-4f3a-8e4c-3235b06ce2af tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:25.960361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f372e7c5-2b4d-4f3a-8e4c-3235b06ce2af tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:25.960802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f372e7c5-2b4d-4f3a-8e4c-3235b06ce2af tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:26.095926 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f372e7c5-2b4d-4f3a-8e4c-3235b06ce2af tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:26.103986 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f372e7c5-2b4d-4f3a-8e4c-3235b06ce2af tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1313 microversion: 2.1 time: 0.156354 Jun 16 15:00:26.104553 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 246/495] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:25 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:26.187832 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2e2257c9-be6e-45e0-a66c-d794651b737e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:26.188445 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2e2257c9-be6e-45e0-a66c-d794651b737e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:26.194580 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2e2257c9-be6e-45e0-a66c-d794651b737e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:26.195022 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2e2257c9-be6e-45e0-a66c-d794651b737e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:26.195779 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2e2257c9-be6e-45e0-a66c-d794651b737e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:26.196236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2e2257c9-be6e-45e0-a66c-d794651b737e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:26.330416 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2e2257c9-be6e-45e0-a66c-d794651b737e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:26.338499 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2e2257c9-be6e-45e0-a66c-d794651b737e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.154688 Jun 16 15:00:26.339059 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 250/496] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:26 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:27.120769 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1612ac86-3412-4b3d-a411-4abe518db786 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:27.121409 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1612ac86-3412-4b3d-a411-4abe518db786 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:27.128029 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1612ac86-3412-4b3d-a411-4abe518db786 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:27.128476 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1612ac86-3412-4b3d-a411-4abe518db786 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:27.129275 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1612ac86-3412-4b3d-a411-4abe518db786 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:27.129708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1612ac86-3412-4b3d-a411-4abe518db786 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:27.262422 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1612ac86-3412-4b3d-a411-4abe518db786 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:27.270076 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1612ac86-3412-4b3d-a411-4abe518db786 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1496 microversion: 2.1 time: 0.153168 Jun 16 15:00:27.270633 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 247/497] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:27 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1496 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:27.355655 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0109091d-8f4a-460d-b7b4-ebd966a4c6a7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:27.356244 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0109091d-8f4a-460d-b7b4-ebd966a4c6a7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:27.362900 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0109091d-8f4a-460d-b7b4-ebd966a4c6a7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:27.363348 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0109091d-8f4a-460d-b7b4-ebd966a4c6a7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:27.364111 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0109091d-8f4a-460d-b7b4-ebd966a4c6a7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:27.364551 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0109091d-8f4a-460d-b7b4-ebd966a4c6a7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:27.502437 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0109091d-8f4a-460d-b7b4-ebd966a4c6a7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:27.510630 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0109091d-8f4a-460d-b7b4-ebd966a4c6a7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.158873 Jun 16 15:00:27.511220 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 251/498] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:27 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:28.528294 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b49cb135-d263-48c5-a100-c02890cf36c1 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:28.529326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b49cb135-d263-48c5-a100-c02890cf36c1 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:28.535858 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b49cb135-d263-48c5-a100-c02890cf36c1 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:28.536318 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b49cb135-d263-48c5-a100-c02890cf36c1 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:28.537676 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b49cb135-d263-48c5-a100-c02890cf36c1 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:28.538122 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b49cb135-d263-48c5-a100-c02890cf36c1 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:28.672004 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b49cb135-d263-48c5-a100-c02890cf36c1 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:28.679708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b49cb135-d263-48c5-a100-c02890cf36c1 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.155491 Jun 16 15:00:28.680268 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 248/499] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:28 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:29.697719 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-811b059f-2c1b-490a-97b7-c230faa3eba5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:29.698378 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-811b059f-2c1b-490a-97b7-c230faa3eba5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:29.704533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-811b059f-2c1b-490a-97b7-c230faa3eba5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:29.704917 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-811b059f-2c1b-490a-97b7-c230faa3eba5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:29.705666 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-811b059f-2c1b-490a-97b7-c230faa3eba5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:29.706126 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-811b059f-2c1b-490a-97b7-c230faa3eba5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:29.849864 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-811b059f-2c1b-490a-97b7-c230faa3eba5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:29.857827 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-811b059f-2c1b-490a-97b7-c230faa3eba5 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.164553 Jun 16 15:00:29.858697 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 252/500] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:29 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:30.875480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e2f0e5a6-5170-4dc2-ae7f-1c71ba47bce3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:30.876083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e2f0e5a6-5170-4dc2-ae7f-1c71ba47bce3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:30.883233 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2f0e5a6-5170-4dc2-ae7f-1c71ba47bce3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:30.883677 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2f0e5a6-5170-4dc2-ae7f-1c71ba47bce3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:30.884588 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2f0e5a6-5170-4dc2-ae7f-1c71ba47bce3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:30.884885 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2f0e5a6-5170-4dc2-ae7f-1c71ba47bce3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:31.013427 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e2f0e5a6-5170-4dc2-ae7f-1c71ba47bce3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:31.020855 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e2f0e5a6-5170-4dc2-ae7f-1c71ba47bce3 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.149256 Jun 16 15:00:31.021467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 249/501] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:30 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:32.039360 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-34f75cd8-3ec0-4f51-9dd4-9398edfbde39 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:32.039961 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-34f75cd8-3ec0-4f51-9dd4-9398edfbde39 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:32.041967 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=70 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:32.047504 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-34f75cd8-3ec0-4f51-9dd4-9398edfbde39 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:32.047949 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-34f75cd8-3ec0-4f51-9dd4-9398edfbde39 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:32.048710 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-34f75cd8-3ec0-4f51-9dd4-9398edfbde39 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:32.049180 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-34f75cd8-3ec0-4f51-9dd4-9398edfbde39 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:32.176894 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-34f75cd8-3ec0-4f51-9dd4-9398edfbde39 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:32.184481 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-34f75cd8-3ec0-4f51-9dd4-9398edfbde39 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.149639 Jun 16 15:00:32.185088 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 253/502] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:32 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:33.202016 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2e16cbe3-fc7c-4752-b688-c472a3460017 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:33.202614 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2e16cbe3-fc7c-4752-b688-c472a3460017 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:33.209274 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e16cbe3-fc7c-4752-b688-c472a3460017 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:33.209732 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e16cbe3-fc7c-4752-b688-c472a3460017 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:33.210494 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e16cbe3-fc7c-4752-b688-c472a3460017 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:33.210935 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e16cbe3-fc7c-4752-b688-c472a3460017 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:33.342902 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2e16cbe3-fc7c-4752-b688-c472a3460017 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:33.350373 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2e16cbe3-fc7c-4752-b688-c472a3460017 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.152342 Jun 16 15:00:33.351468 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 250/503] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:33 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:34.367916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8a672a98-e575-4cac-8165-2df3a8c47169 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:34.368511 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8a672a98-e575-4cac-8165-2df3a8c47169 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:34.374667 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a672a98-e575-4cac-8165-2df3a8c47169 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:34.375118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a672a98-e575-4cac-8165-2df3a8c47169 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:34.375879 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a672a98-e575-4cac-8165-2df3a8c47169 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:34.376315 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a672a98-e575-4cac-8165-2df3a8c47169 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:34.509294 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8a672a98-e575-4cac-8165-2df3a8c47169 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:34.516767 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8a672a98-e575-4cac-8165-2df3a8c47169 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.153185 Jun 16 15:00:34.517363 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 254/504] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:34 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:34.827714 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d1c86d0b-a247-4908-8525-1bd69dc1c58a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:34.828314 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d1c86d0b-a247-4908-8525-1bd69dc1c58a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:34.834976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d1c86d0b-a247-4908-8525-1bd69dc1c58a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:34.835428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d1c86d0b-a247-4908-8525-1bd69dc1c58a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:34.836204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d1c86d0b-a247-4908-8525-1bd69dc1c58a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:34.836647 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d1c86d0b-a247-4908-8525-1bd69dc1c58a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:34.840948 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:34.863715 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d1c86d0b-a247-4908-8525-1bd69dc1c58a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:00:34.946424 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d1c86d0b-a247-4908-8525-1bd69dc1c58a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "DELETE /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 204 len: 0 microversion: 2.1 time: 0.122319 Jun 16 15:00:34.947105 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 251/505] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:00:34 2022] DELETE /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 15:00:34.955728 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-74a4dc66-8191-45fa-a2df-055e4d165452 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:34.956339 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-74a4dc66-8191-45fa-a2df-055e4d165452 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:34.963119 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-74a4dc66-8191-45fa-a2df-055e4d165452 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:34.963570 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-74a4dc66-8191-45fa-a2df-055e4d165452 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:34.964327 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-74a4dc66-8191-45fa-a2df-055e4d165452 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:34.964759 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-74a4dc66-8191-45fa-a2df-055e4d165452 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:35.097651 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-74a4dc66-8191-45fa-a2df-055e4d165452 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:35.105269 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-74a4dc66-8191-45fa-a2df-055e4d165452 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1502 microversion: 2.1 time: 0.153240 Jun 16 15:00:35.105828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 255/506] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:34 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:35.534235 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-05ac9963-314d-4800-b270-6af5e69f2693 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:35.534932 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-05ac9963-314d-4800-b270-6af5e69f2693 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:35.541536 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-05ac9963-314d-4800-b270-6af5e69f2693 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:35.541996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-05ac9963-314d-4800-b270-6af5e69f2693 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:35.542764 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-05ac9963-314d-4800-b270-6af5e69f2693 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:35.543208 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-05ac9963-314d-4800-b270-6af5e69f2693 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:35.671879 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-05ac9963-314d-4800-b270-6af5e69f2693 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:35.680053 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-05ac9963-314d-4800-b270-6af5e69f2693 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.150017 Jun 16 15:00:35.680616 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 252/507] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:35 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:36.121965 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-bfc7411e-1aed-4eed-adb8-57505cc45b7a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:36.122589 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-bfc7411e-1aed-4eed-adb8-57505cc45b7a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:36.128717 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bfc7411e-1aed-4eed-adb8-57505cc45b7a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:36.129207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bfc7411e-1aed-4eed-adb8-57505cc45b7a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:36.129965 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bfc7411e-1aed-4eed-adb8-57505cc45b7a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:36.130403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bfc7411e-1aed-4eed-adb8-57505cc45b7a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:36.262587 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bfc7411e-1aed-4eed-adb8-57505cc45b7a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:36.270071 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-bfc7411e-1aed-4eed-adb8-57505cc45b7a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1502 microversion: 2.1 time: 0.151976 Jun 16 15:00:36.270623 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 256/508] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:36 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1502 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:36.697144 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ef6bddef-4b4a-4389-9b5c-9287fc2b867d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:36.697805 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ef6bddef-4b4a-4389-9b5c-9287fc2b867d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:36.705600 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ef6bddef-4b4a-4389-9b5c-9287fc2b867d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:36.706051 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ef6bddef-4b4a-4389-9b5c-9287fc2b867d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:36.706849 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ef6bddef-4b4a-4389-9b5c-9287fc2b867d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:36.707284 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ef6bddef-4b4a-4389-9b5c-9287fc2b867d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:36.835434 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ef6bddef-4b4a-4389-9b5c-9287fc2b867d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:36.843633 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ef6bddef-4b4a-4389-9b5c-9287fc2b867d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.150351 Jun 16 15:00:36.844202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 253/509] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:36 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:37.286218 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8a52bc84-9289-4c9b-ad6a-9034204f14cd tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:37.286822 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8a52bc84-9289-4c9b-ad6a-9034204f14cd tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:37.292779 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a52bc84-9289-4c9b-ad6a-9034204f14cd tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:37.293252 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a52bc84-9289-4c9b-ad6a-9034204f14cd tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:37.294003 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a52bc84-9289-4c9b-ad6a-9034204f14cd tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:37.294436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a52bc84-9289-4c9b-ad6a-9034204f14cd tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:37.431158 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8a52bc84-9289-4c9b-ad6a-9034204f14cd tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:37.438699 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8a52bc84-9289-4c9b-ad6a-9034204f14cd tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1502 microversion: 2.1 time: 0.156240 Jun 16 15:00:37.439295 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 257/510] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:37 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:37.860423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7fc1ac00-ce83-45a9-80b7-0c85595ed470 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:37.861063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7fc1ac00-ce83-45a9-80b7-0c85595ed470 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:37.868245 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7fc1ac00-ce83-45a9-80b7-0c85595ed470 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:37.868728 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7fc1ac00-ce83-45a9-80b7-0c85595ed470 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:37.869528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7fc1ac00-ce83-45a9-80b7-0c85595ed470 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:37.869969 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7fc1ac00-ce83-45a9-80b7-0c85595ed470 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:38.088266 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7fc1ac00-ce83-45a9-80b7-0c85595ed470 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:38.096269 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7fc1ac00-ce83-45a9-80b7-0c85595ed470 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.239656 Jun 16 15:00:38.096863 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 254/511] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:37 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:38.319023 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-df3b1576-b8a5-4119-9ed7-606e9d22c3d6 req-850f026a-7ef5-46b5-9382-577b511771df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03533502-cce0-4b66-a223-974d7c2d69e3", "name": "network-vif-deleted", "tag": "007d803c-5b61-4f7b-85da-08d5f1236816"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:38.328661 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-df3b1576-b8a5-4119-9ed7-606e9d22c3d6 req-850f026a-7ef5-46b5-9382-577b511771df service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:38.329136 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-df3b1576-b8a5-4119-9ed7-606e9d22c3d6 req-850f026a-7ef5-46b5-9382-577b511771df service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:38.341636 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-df3b1576-b8a5-4119-9ed7-606e9d22c3d6 req-850f026a-7ef5-46b5-9382-577b511771df service nova] Creating event network-vif-deleted:007d803c-5b61-4f7b-85da-08d5f1236816 for instance 03533502-cce0-4b66-a223-974d7c2d69e3 on hv-cinder-83716 Jun 16 15:00:38.347076 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-df3b1576-b8a5-4119-9ed7-606e9d22c3d6 req-850f026a-7ef5-46b5-9382-577b511771df service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031832 Jun 16 15:00:38.348058 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 258/512] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:00:38.458412 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-47f744b5-6803-4728-a7e2-32dd25703de1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:38.459071 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-47f744b5-6803-4728-a7e2-32dd25703de1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:38.466092 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-47f744b5-6803-4728-a7e2-32dd25703de1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:38.466460 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-47f744b5-6803-4728-a7e2-32dd25703de1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:38.467251 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-47f744b5-6803-4728-a7e2-32dd25703de1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:38.467690 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-47f744b5-6803-4728-a7e2-32dd25703de1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:38.505113 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-47f744b5-6803-4728-a7e2-32dd25703de1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:38.505572 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-47f744b5-6803-4728-a7e2-32dd25703de1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:38.506039 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-47f744b5-6803-4728-a7e2-32dd25703de1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lazy-loading 'fault' on Instance uuid 03533502-cce0-4b66-a223-974d7c2d69e3 {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:00:38.559382 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-47f744b5-6803-4728-a7e2-32dd25703de1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:38.567900 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-47f744b5-6803-4728-a7e2-32dd25703de1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 200 len: 1303 microversion: 2.1 time: 0.114922 Jun 16 15:00:38.568491 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 255/513] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:38 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 1303 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:39.113832 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-86dee95d-0c59-4d88-8b22-bdc95b35bc55 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:39.114633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-86dee95d-0c59-4d88-8b22-bdc95b35bc55 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:39.121108 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-86dee95d-0c59-4d88-8b22-bdc95b35bc55 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:39.121549 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-86dee95d-0c59-4d88-8b22-bdc95b35bc55 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:39.122404 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-86dee95d-0c59-4d88-8b22-bdc95b35bc55 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:39.122869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-86dee95d-0c59-4d88-8b22-bdc95b35bc55 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:39.141210 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:39.257180 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-86dee95d-0c59-4d88-8b22-bdc95b35bc55 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:39.265208 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-86dee95d-0c59-4d88-8b22-bdc95b35bc55 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.155593 Jun 16 15:00:39.265782 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 259/514] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:39 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:39.585164 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-46e03743-b5f1-457c-85dd-e9234090199d tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:39.589799 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-46e03743-b5f1-457c-85dd-e9234090199d tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 03533502-cce0-4b66-a223-974d7c2d69e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:39.596498 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-46e03743-b5f1-457c-85dd-e9234090199d tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:39.597084 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-46e03743-b5f1-457c-85dd-e9234090199d tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:39.597837 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-46e03743-b5f1-457c-85dd-e9234090199d tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:39.598275 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-46e03743-b5f1-457c-85dd-e9234090199d tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:39.611504 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-46e03743-b5f1-457c-85dd-e9234090199d tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] HTTP exception thrown: Instance 03533502-cce0-4b66-a223-974d7c2d69e3 could not be found. Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-46e03743-b5f1-457c-85dd-e9234090199d tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Request method failure captured: Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 HTTP/1.1 Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0Vfxch2q4A-ddSWSnysAXz3mwL6A-VgzhEqKSYG9kSPDF5OCje9YunWAGSF9fkmFGPPKGkCVnha2oqj96skzPj0eQ0mKs7lJYaQ7itTuNltRUHNz9GkCmvH8jkzhS1UtH-Vdfkw3lTOZ2VEX99XYBfK8yLQHdNBxzuK-ONQOyvL3ko Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 8bfa0f9f3251447c922938888ddea917 Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-VolumesActionsTest-1903567955 Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:00:39.613176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:00:39.614722 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8bfa0f9f3251447c922938888ddea917", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8bfa0f9f3251447c922938888ddea917"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8bfa0f9f3251447c922938888ddea917"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8bfa0f9f3251447c922938888ddea917"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:00:39.614722 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-VolumesActionsTest-1903567955 Jun 16 15:00:39.614722 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 8bfa0f9f3251447c922938888ddea917 Jun 16 15:00:39.614722 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-VolumesActionsTest-1903567955 Jun 16 15:00:39.614722 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-VolumesActionsTest-1903567955-project Jun 16 15:00:39.614722 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:00:39.614722 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:00:39.614722 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: aab9d86304804cb189c0c1d065d7e7b1 Jun 16 15:00:39.614722 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-VolumesActionsTest-1903567955-project Jun 16 15:00:39.614722 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:00:39.614722 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance 03533502-cce0-4b66-a223-974d7c2d69e3 could not be found. Jun 16 15:00:39.614722 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': '03533502-cce0-4b66-a223-974d7c2d69e3'} Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03533502-cce0-4b66-a223-974d7c2d69e3 could not be found. Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:00:39.615634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:00:39.617218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:00:39.617218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:00:39.617218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:00:39.617218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:00:39.617218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:00:39.617218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:00:39.617218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:00:39.617218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03533502-cce0-4b66-a223-974d7c2d69e3 could not be found. Jun 16 15:00:39.617218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:00:39.617218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:00:39.617218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:00:39.617218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:00:39.617218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:00:39.617218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:00:39.617218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:00:39.617218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:00:39.617218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03533502-cce0-4b66-a223-974d7c2d69e3 could not be found. Jun 16 15:00:39.617218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:00:39.619232 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-46e03743-b5f1-457c-85dd-e9234090199d tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Returning 404 to user: Instance 03533502-cce0-4b66-a223-974d7c2d69e3 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:00:39.619232 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-46e03743-b5f1-457c-85dd-e9234090199d tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3" status: 404 len: 111 microversion: 2.1 time: 0.033146 Jun 16 15:00:39.619232 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 256/515] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:39 2022] GET /compute/v2.1/servers/03533502-cce0-4b66-a223-974d7c2d69e3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:00:39.715650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2e352086-0238-4c40-9e72-1e85dc63d7b1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1395517436", "imageRef": "23371504-a4d6-4064-90b4-87bfd0a15170", "flavorRef": "452", "networks": [{"uuid": "07db0cfb-ec4f-4004-a40d-4f4a390f3311"}]}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:39.770462 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.network.neutron [None req-2e352086-0238-4c40-9e72-1e85dc63d7b1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] validate_networks() for [('07db0cfb-ec4f-4004-a40d-4f4a390f3311', None, None, None, None, None)] {{(pid=124589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:00:40.283193 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f5298940-a324-4d61-baf7-6a39f840c0ee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:40.284056 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f5298940-a324-4d61-baf7-6a39f840c0ee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:40.292564 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5298940-a324-4d61-baf7-6a39f840c0ee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:40.293217 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5298940-a324-4d61-baf7-6a39f840c0ee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:40.293996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5298940-a324-4d61-baf7-6a39f840c0ee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:40.294441 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5298940-a324-4d61-baf7-6a39f840c0ee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:40.343315 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-2e352086-0238-4c40-9e72-1e85dc63d7b1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Flavor limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:00:40.343738 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-2e352086-0238-4c40-9e72-1e85dc63d7b1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Image limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:00:40.344212 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-2e352086-0238-4c40-9e72-1e85dc63d7b1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Flavor pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:00:40.344627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-2e352086-0238-4c40-9e72-1e85dc63d7b1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Image pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:00:40.345076 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-2e352086-0238-4c40-9e72-1e85dc63d7b1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:00:40.354777 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2e352086-0238-4c40-9e72-1e85dc63d7b1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:40.355227 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2e352086-0238-4c40-9e72-1e85dc63d7b1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:40.356026 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2e352086-0238-4c40-9e72-1e85dc63d7b1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:40.356465 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2e352086-0238-4c40-9e72-1e85dc63d7b1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:40.374172 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-2e352086-0238-4c40-9e72-1e85dc63d7b1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Getting quotas for project 8bfa0f9f3251447c922938888ddea917. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:00:40.378442 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-2e352086-0238-4c40-9e72-1e85dc63d7b1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Getting quotas for user aab9d86304804cb189c0c1d065d7e7b1 and project 8bfa0f9f3251447c922938888ddea917. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:00:40.397589 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2e352086-0238-4c40-9e72-1e85dc63d7b1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Going to run 1 instances... {{(pid=124589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:00:40.401176 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2e352086-0238-4c40-9e72-1e85dc63d7b1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23371504-a4d6-4064-90b4-87bfd0a15170',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:00:40.437922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f5298940-a324-4d61-baf7-6a39f840c0ee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:40.445329 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f5298940-a324-4d61-baf7-6a39f840c0ee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.165867 Jun 16 15:00:40.447578 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 257/516] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:40 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:40.450201 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2e352086-0238-4c40-9e72-1e85dc63d7b1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.738417 Jun 16 15:00:40.451265 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 260/517] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 15:00:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 15:00:40.461197 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2c25c5b0-401b-4b5b-a8ff-90ca69f010f0 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:40.461844 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2c25c5b0-401b-4b5b-a8ff-90ca69f010f0 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:40.515879 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2c25c5b0-401b-4b5b-a8ff-90ca69f010f0 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:40.522969 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2c25c5b0-401b-4b5b-a8ff-90ca69f010f0 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1214 microversion: 2.1 time: 0.065381 Jun 16 15:00:40.523904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 258/518] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:40 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:41.465381 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7aa81293-8865-4412-8ebb-581212769e9d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:41.466025 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7aa81293-8865-4412-8ebb-581212769e9d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:41.472343 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7aa81293-8865-4412-8ebb-581212769e9d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:41.472775 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7aa81293-8865-4412-8ebb-581212769e9d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:41.473647 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7aa81293-8865-4412-8ebb-581212769e9d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:41.474077 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7aa81293-8865-4412-8ebb-581212769e9d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:41.540077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f32686bd-7776-411c-bcf4-f7be0bce0e09 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:41.540695 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f32686bd-7776-411c-bcf4-f7be0bce0e09 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:41.552496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f32686bd-7776-411c-bcf4-f7be0bce0e09 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:41.553236 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f32686bd-7776-411c-bcf4-f7be0bce0e09 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:41.554184 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f32686bd-7776-411c-bcf4-f7be0bce0e09 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:41.554781 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f32686bd-7776-411c-bcf4-f7be0bce0e09 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:41.635516 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7aa81293-8865-4412-8ebb-581212769e9d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:41.643616 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7aa81293-8865-4412-8ebb-581212769e9d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.183513 Jun 16 15:00:41.644436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 261/519] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:41 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:41.649892 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a150dd94-ea35-4068-83c7-e42f7db87ad2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1790561551", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1659470293", "security_groups": [{"name": "tempest-secgroup-smoke-425536924"}], "block_device_mapping_v2": [{"uuid": "416ef13b-afa0-40fe-bbd4-824f48e86465", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "90f95ec0-4a81-440f-8fe5-a85002b7b63b"}]}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:41.661162 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f32686bd-7776-411c-bcf4-f7be0bce0e09 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:41.669260 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f32686bd-7776-411c-bcf4-f7be0bce0e09 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1274 microversion: 2.1 time: 0.132925 Jun 16 15:00:41.670458 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 259/520] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:41 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:41.800638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.network.neutron [None req-a150dd94-ea35-4068-83c7-e42f7db87ad2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] validate_networks() for [('90f95ec0-4a81-440f-8fe5-a85002b7b63b', None, None, None, None, None)] {{(pid=124589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:00:42.250110 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-a150dd94-ea35-4068-83c7-e42f7db87ad2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Flavor limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:00:42.250697 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-a150dd94-ea35-4068-83c7-e42f7db87ad2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Image limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:00:42.251163 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-a150dd94-ea35-4068-83c7-e42f7db87ad2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Flavor pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:00:42.251797 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-a150dd94-ea35-4068-83c7-e42f7db87ad2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Image pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:00:42.252514 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-a150dd94-ea35-4068-83c7-e42f7db87ad2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:00:42.262558 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a150dd94-ea35-4068-83c7-e42f7db87ad2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:42.263273 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a150dd94-ea35-4068-83c7-e42f7db87ad2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:42.264056 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a150dd94-ea35-4068-83c7-e42f7db87ad2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:42.264740 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a150dd94-ea35-4068-83c7-e42f7db87ad2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:42.285529 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-a150dd94-ea35-4068-83c7-e42f7db87ad2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Getting quotas for project 05223500b4a142c7a77c2de010541b84. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:00:42.289969 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-a150dd94-ea35-4068-83c7-e42f7db87ad2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Getting quotas for user 9d977f609537476daa8fe8adbab9ff9c and project 05223500b4a142c7a77c2de010541b84. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:00:42.366936 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a150dd94-ea35-4068-83c7-e42f7db87ad2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Going to run 1 instances... {{(pid=124589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:00:42.370729 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a150dd94-ea35-4068-83c7-e42f7db87ad2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='416ef13b-afa0-40fe-bbd4-824f48e86465',volume_size=None,volume_type=None)] {{(pid=124589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:00:42.509416 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a150dd94-ea35-4068-83c7-e42f7db87ad2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.863659 Jun 16 15:00:42.510540 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 262/521] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 15:00:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 15:00:42.520160 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-63e6a86d-73ce-4eb3-9505-462b13775124 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:42.521099 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-63e6a86d-73ce-4eb3-9505-462b13775124 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:42.662012 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f4809c9d-37ed-4839-8f09-6f9f8faed9de tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:42.662647 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f4809c9d-37ed-4839-8f09-6f9f8faed9de tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:42.671672 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f4809c9d-37ed-4839-8f09-6f9f8faed9de tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:42.672531 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f4809c9d-37ed-4839-8f09-6f9f8faed9de tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:42.673341 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f4809c9d-37ed-4839-8f09-6f9f8faed9de tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:42.673775 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f4809c9d-37ed-4839-8f09-6f9f8faed9de tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:42.686232 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-63e6a86d-73ce-4eb3-9505-462b13775124 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:42.694043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-63e6a86d-73ce-4eb3-9505-462b13775124 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1095 microversion: 2.1 time: 0.177696 Jun 16 15:00:42.694613 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 260/522] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:42 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1095 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:42.700078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0cead07a-e4b4-45c6-ac2d-288d2f323efd tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:42.700963 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0cead07a-e4b4-45c6-ac2d-288d2f323efd tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:42.708465 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0cead07a-e4b4-45c6-ac2d-288d2f323efd tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:42.709299 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0cead07a-e4b4-45c6-ac2d-288d2f323efd tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:42.710304 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0cead07a-e4b4-45c6-ac2d-288d2f323efd tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:42.711617 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0cead07a-e4b4-45c6-ac2d-288d2f323efd tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:42.846581 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f4809c9d-37ed-4839-8f09-6f9f8faed9de tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:42.855760 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f4809c9d-37ed-4839-8f09-6f9f8faed9de tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.197468 Jun 16 15:00:42.856343 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 263/523] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:42 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:43.069716 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0cead07a-e4b4-45c6-ac2d-288d2f323efd tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:43.080128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0cead07a-e4b4-45c6-ac2d-288d2f323efd tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1314 microversion: 2.1 time: 0.384203 Jun 16 15:00:43.081141 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 261/524] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:42 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:43.317421 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-39b8da3f-29e9-41d1-8e04-c0947cc59830 req-1772fc63-ed1b-4a15-8ac5-c926861bf9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71ea6009-6544-47c1-95bd-71542078db07", "tag": "616d7d20-0334-4e53-aae7-4c527c1c1fca"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:43.327150 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-39b8da3f-29e9-41d1-8e04-c0947cc59830 req-1772fc63-ed1b-4a15-8ac5-c926861bf9d3 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:43.327511 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-39b8da3f-29e9-41d1-8e04-c0947cc59830 req-1772fc63-ed1b-4a15-8ac5-c926861bf9d3 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:43.339993 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-39b8da3f-29e9-41d1-8e04-c0947cc59830 req-1772fc63-ed1b-4a15-8ac5-c926861bf9d3 service nova] Creating event network-changed:616d7d20-0334-4e53-aae7-4c527c1c1fca for instance 71ea6009-6544-47c1-95bd-71542078db07 on hv-cinder-83716 Jun 16 15:00:43.345055 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-39b8da3f-29e9-41d1-8e04-c0947cc59830 req-1772fc63-ed1b-4a15-8ac5-c926861bf9d3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031341 Jun 16 15:00:43.345658 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 264/525] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:00:43.712736 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e6b71a66-73e9-40fa-86a1-2fdd0e0f9fdd tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:43.713557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e6b71a66-73e9-40fa-86a1-2fdd0e0f9fdd tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:43.730311 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6b71a66-73e9-40fa-86a1-2fdd0e0f9fdd tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:43.730816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6b71a66-73e9-40fa-86a1-2fdd0e0f9fdd tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:43.732272 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6b71a66-73e9-40fa-86a1-2fdd0e0f9fdd tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:43.732789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6b71a66-73e9-40fa-86a1-2fdd0e0f9fdd tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:43.855646 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e6b71a66-73e9-40fa-86a1-2fdd0e0f9fdd tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:43.863934 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e6b71a66-73e9-40fa-86a1-2fdd0e0f9fdd tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1201 microversion: 2.1 time: 0.155193 Jun 16 15:00:43.864502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 262/526] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:43 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1201 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:43.879433 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5c473e0f-1058-44f3-b8e8-f967189f0f29 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:43.880995 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5c473e0f-1058-44f3-b8e8-f967189f0f29 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:43.889351 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c473e0f-1058-44f3-b8e8-f967189f0f29 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:43.889923 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c473e0f-1058-44f3-b8e8-f967189f0f29 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:43.890828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c473e0f-1058-44f3-b8e8-f967189f0f29 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:43.891337 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c473e0f-1058-44f3-b8e8-f967189f0f29 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:44.063792 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5c473e0f-1058-44f3-b8e8-f967189f0f29 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:44.071874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5c473e0f-1058-44f3-b8e8-f967189f0f29 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.201140 Jun 16 15:00:44.072631 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 265/527] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:43 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:44.098856 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2433b13d-e51d-4978-8282-6b9b0b34090a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:44.099504 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2433b13d-e51d-4978-8282-6b9b0b34090a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:44.107173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2433b13d-e51d-4978-8282-6b9b0b34090a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:44.107729 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2433b13d-e51d-4978-8282-6b9b0b34090a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:44.108506 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2433b13d-e51d-4978-8282-6b9b0b34090a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:44.108985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2433b13d-e51d-4978-8282-6b9b0b34090a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:44.452669 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2433b13d-e51d-4978-8282-6b9b0b34090a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:44.460519 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2433b13d-e51d-4978-8282-6b9b0b34090a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1314 microversion: 2.1 time: 0.366516 Jun 16 15:00:44.461186 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 263/528] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:44 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:44.883991 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e23d4d66-4b3a-4360-af6c-2e1304beda11 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:44.886514 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e23d4d66-4b3a-4360-af6c-2e1304beda11 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:44.893151 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e23d4d66-4b3a-4360-af6c-2e1304beda11 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:44.894476 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e23d4d66-4b3a-4360-af6c-2e1304beda11 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:44.895831 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e23d4d66-4b3a-4360-af6c-2e1304beda11 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:44.896413 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e23d4d66-4b3a-4360-af6c-2e1304beda11 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:44.971032 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e23d4d66-4b3a-4360-af6c-2e1304beda11 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:44.987019 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e23d4d66-4b3a-4360-af6c-2e1304beda11 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1211 microversion: 2.1 time: 0.108745 Jun 16 15:00:44.987602 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 266/529] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:44 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1211 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:45.089897 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5e895dc4-b48b-44ee-9830-b9a1875da114 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:45.090679 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5e895dc4-b48b-44ee-9830-b9a1875da114 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:45.097876 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5e895dc4-b48b-44ee-9830-b9a1875da114 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:45.098409 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5e895dc4-b48b-44ee-9830-b9a1875da114 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:45.099270 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5e895dc4-b48b-44ee-9830-b9a1875da114 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:45.099880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5e895dc4-b48b-44ee-9830-b9a1875da114 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:45.322919 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5e895dc4-b48b-44ee-9830-b9a1875da114 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:45.330915 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5e895dc4-b48b-44ee-9830-b9a1875da114 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.245012 Jun 16 15:00:45.331808 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 264/530] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:45 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:45.478526 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-14651aec-743a-4c3b-ae3e-23913934e963 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:45.479032 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-14651aec-743a-4c3b-ae3e-23913934e963 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:45.485250 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-14651aec-743a-4c3b-ae3e-23913934e963 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:45.485747 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-14651aec-743a-4c3b-ae3e-23913934e963 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:45.486612 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-14651aec-743a-4c3b-ae3e-23913934e963 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:45.487279 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-14651aec-743a-4c3b-ae3e-23913934e963 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:45.617565 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-14651aec-743a-4c3b-ae3e-23913934e963 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:45.624927 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-14651aec-743a-4c3b-ae3e-23913934e963 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1314 microversion: 2.1 time: 0.151081 Jun 16 15:00:45.625494 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 267/531] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:45 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:46.004827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b3c9bc0c-de31-4a6f-8dab-320888fa6031 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:46.005468 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b3c9bc0c-de31-4a6f-8dab-320888fa6031 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:46.012052 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3c9bc0c-de31-4a6f-8dab-320888fa6031 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:46.012532 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3c9bc0c-de31-4a6f-8dab-320888fa6031 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:46.013597 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3c9bc0c-de31-4a6f-8dab-320888fa6031 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:46.014035 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3c9bc0c-de31-4a6f-8dab-320888fa6031 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:46.146831 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b3c9bc0c-de31-4a6f-8dab-320888fa6031 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:46.155244 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b3c9bc0c-de31-4a6f-8dab-320888fa6031 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1278 microversion: 2.1 time: 0.154481 Jun 16 15:00:46.155801 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 265/532] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:45 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:46.349294 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-809f3f5b-04b6-487a-9a89-fd1236d952f1 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:46.349996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-809f3f5b-04b6-487a-9a89-fd1236d952f1 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:46.358259 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-809f3f5b-04b6-487a-9a89-fd1236d952f1 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:46.358711 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-809f3f5b-04b6-487a-9a89-fd1236d952f1 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:46.359490 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-809f3f5b-04b6-487a-9a89-fd1236d952f1 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:46.365689 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-809f3f5b-04b6-487a-9a89-fd1236d952f1 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:46.563912 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-809f3f5b-04b6-487a-9a89-fd1236d952f1 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:46.573585 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-809f3f5b-04b6-487a-9a89-fd1236d952f1 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.229796 Jun 16 15:00:46.574661 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 268/533] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:46 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:46.642897 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8da087fd-eb47-488b-9894-4e8a0835309b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:46.643947 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8da087fd-eb47-488b-9894-4e8a0835309b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:46.651530 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8da087fd-eb47-488b-9894-4e8a0835309b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:46.652002 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8da087fd-eb47-488b-9894-4e8a0835309b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:46.653384 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8da087fd-eb47-488b-9894-4e8a0835309b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:46.654121 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8da087fd-eb47-488b-9894-4e8a0835309b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:46.909924 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8da087fd-eb47-488b-9894-4e8a0835309b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:46.918198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8da087fd-eb47-488b-9894-4e8a0835309b tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1314 microversion: 2.1 time: 0.280063 Jun 16 15:00:46.918766 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 266/534] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:46 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:47.171702 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-66a6fe1b-2adf-4045-bd1d-3c62831b0a63 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:47.172318 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-66a6fe1b-2adf-4045-bd1d-3c62831b0a63 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:47.178587 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-66a6fe1b-2adf-4045-bd1d-3c62831b0a63 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:47.179036 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-66a6fe1b-2adf-4045-bd1d-3c62831b0a63 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:47.179841 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-66a6fe1b-2adf-4045-bd1d-3c62831b0a63 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:47.180295 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-66a6fe1b-2adf-4045-bd1d-3c62831b0a63 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:47.251772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-d712b4dc-4392-4602-bb6d-f15a13d4a5f2 req-e5e31ec5-ce35-4e22-bf9c-105157a6b194 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9376dd84-3783-460a-b0af-43ae018a961e", "tag": "01ec3b9b-b35a-4c46-8071-a79f0aa795db"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:47.258435 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:47.262822 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-d712b4dc-4392-4602-bb6d-f15a13d4a5f2 req-e5e31ec5-ce35-4e22-bf9c-105157a6b194 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:47.263389 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-d712b4dc-4392-4602-bb6d-f15a13d4a5f2 req-e5e31ec5-ce35-4e22-bf9c-105157a6b194 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:47.285023 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-d712b4dc-4392-4602-bb6d-f15a13d4a5f2 req-e5e31ec5-ce35-4e22-bf9c-105157a6b194 service nova] Creating event network-changed:01ec3b9b-b35a-4c46-8071-a79f0aa795db for instance 9376dd84-3783-460a-b0af-43ae018a961e on hv-cinder-83716 Jun 16 15:00:47.292622 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-d712b4dc-4392-4602-bb6d-f15a13d4a5f2 req-e5e31ec5-ce35-4e22-bf9c-105157a6b194 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046056 Jun 16 15:00:47.293353 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 267/535] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:00:47.311943 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:00:47.312194 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Thu Jun 16 15:00:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e (ip 10.222.0.72) !!! Jun 16 15:00:47.351123 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-66a6fe1b-2adf-4045-bd1d-3c62831b0a63 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:47.358985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-66a6fe1b-2adf-4045-bd1d-3c62831b0a63 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1266 microversion: 2.1 time: 0.191168 Jun 16 15:00:47.359591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 269/536] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:47 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:47.591871 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-834e9a73-312f-4d9f-9e45-54b5586f7942 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:47.592568 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-834e9a73-312f-4d9f-9e45-54b5586f7942 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:47.598778 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-834e9a73-312f-4d9f-9e45-54b5586f7942 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:47.599228 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-834e9a73-312f-4d9f-9e45-54b5586f7942 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:47.599986 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-834e9a73-312f-4d9f-9e45-54b5586f7942 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:47.600423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-834e9a73-312f-4d9f-9e45-54b5586f7942 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:47.730418 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-834e9a73-312f-4d9f-9e45-54b5586f7942 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:47.737955 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-834e9a73-312f-4d9f-9e45-54b5586f7942 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.150301 Jun 16 15:00:47.738570 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 268/537] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:47 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:47.935003 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-04e69a37-5afb-4929-ac89-eff5498ba109 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:47.935656 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-04e69a37-5afb-4929-ac89-eff5498ba109 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:47.946738 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04e69a37-5afb-4929-ac89-eff5498ba109 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:47.947542 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04e69a37-5afb-4929-ac89-eff5498ba109 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:47.948955 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04e69a37-5afb-4929-ac89-eff5498ba109 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:47.949751 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04e69a37-5afb-4929-ac89-eff5498ba109 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:48.096495 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-04e69a37-5afb-4929-ac89-eff5498ba109 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:48.106261 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-04e69a37-5afb-4929-ac89-eff5498ba109 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1314 microversion: 2.1 time: 0.175090 Jun 16 15:00:48.107322 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 270/538] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:47 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:48.375906 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9764bb06-176d-4724-8ab2-9f66550a6633 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:48.376531 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9764bb06-176d-4724-8ab2-9f66550a6633 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:48.383126 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9764bb06-176d-4724-8ab2-9f66550a6633 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:48.383586 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9764bb06-176d-4724-8ab2-9f66550a6633 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:48.384362 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9764bb06-176d-4724-8ab2-9f66550a6633 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:48.384803 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9764bb06-176d-4724-8ab2-9f66550a6633 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:48.388990 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:48.516230 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9764bb06-176d-4724-8ab2-9f66550a6633 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:48.523915 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9764bb06-176d-4724-8ab2-9f66550a6633 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1266 microversion: 2.1 time: 0.151788 Jun 16 15:00:48.524476 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 269/539] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:48 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:48.757372 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4b85908c-759b-458f-9437-dce812f4beec tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:48.758646 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4b85908c-759b-458f-9437-dce812f4beec tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:48.766971 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4b85908c-759b-458f-9437-dce812f4beec tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:48.767494 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4b85908c-759b-458f-9437-dce812f4beec tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:48.768509 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4b85908c-759b-458f-9437-dce812f4beec tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:48.769198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4b85908c-759b-458f-9437-dce812f4beec tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:48.914842 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4b85908c-759b-458f-9437-dce812f4beec tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:48.922262 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4b85908c-759b-458f-9437-dce812f4beec tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.169063 Jun 16 15:00:48.922810 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 271/540] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:48 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:49.123595 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-125f7e29-c015-4145-8007-c47742eaf725 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:49.124249 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-125f7e29-c015-4145-8007-c47742eaf725 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:49.130644 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-125f7e29-c015-4145-8007-c47742eaf725 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:49.131093 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-125f7e29-c015-4145-8007-c47742eaf725 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:49.131851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-125f7e29-c015-4145-8007-c47742eaf725 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:49.132279 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-125f7e29-c015-4145-8007-c47742eaf725 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:49.269514 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-125f7e29-c015-4145-8007-c47742eaf725 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:49.277548 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-125f7e29-c015-4145-8007-c47742eaf725 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1314 microversion: 2.1 time: 0.157763 Jun 16 15:00:49.278107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 270/541] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:49 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:49.540868 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7cdf314e-4ab8-4695-9152-0cd8917d9179 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:49.541484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7cdf314e-4ab8-4695-9152-0cd8917d9179 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:49.547445 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7cdf314e-4ab8-4695-9152-0cd8917d9179 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:49.547894 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7cdf314e-4ab8-4695-9152-0cd8917d9179 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:49.548649 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7cdf314e-4ab8-4695-9152-0cd8917d9179 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:49.549109 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7cdf314e-4ab8-4695-9152-0cd8917d9179 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:49.684214 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7cdf314e-4ab8-4695-9152-0cd8917d9179 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:49.692502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7cdf314e-4ab8-4695-9152-0cd8917d9179 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1266 microversion: 2.1 time: 0.155858 Jun 16 15:00:49.693141 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 272/542] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:49 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:49.940104 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-75bc2f1b-f4ed-44dd-a276-f1ede6e56880 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:49.940866 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-75bc2f1b-f4ed-44dd-a276-f1ede6e56880 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:49.948538 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-75bc2f1b-f4ed-44dd-a276-f1ede6e56880 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:49.949149 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-75bc2f1b-f4ed-44dd-a276-f1ede6e56880 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:49.950014 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-75bc2f1b-f4ed-44dd-a276-f1ede6e56880 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:49.950594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-75bc2f1b-f4ed-44dd-a276-f1ede6e56880 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:50.099617 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-75bc2f1b-f4ed-44dd-a276-f1ede6e56880 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:50.107629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-75bc2f1b-f4ed-44dd-a276-f1ede6e56880 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.171626 Jun 16 15:00:50.108387 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 271/543] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:49 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:50.294436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ec78714f-0168-4e10-ae6f-c5ced990661a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:50.295088 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ec78714f-0168-4e10-ae6f-c5ced990661a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:50.300991 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ec78714f-0168-4e10-ae6f-c5ced990661a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:50.301642 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ec78714f-0168-4e10-ae6f-c5ced990661a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:50.302404 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ec78714f-0168-4e10-ae6f-c5ced990661a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:50.302883 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ec78714f-0168-4e10-ae6f-c5ced990661a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:50.447542 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ec78714f-0168-4e10-ae6f-c5ced990661a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:50.456040 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ec78714f-0168-4e10-ae6f-c5ced990661a tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1314 microversion: 2.1 time: 0.165238 Jun 16 15:00:50.456874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 273/544] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:50 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:50.712607 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f5ffe127-2165-4374-a142-f6eab3789395 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:50.714312 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f5ffe127-2165-4374-a142-f6eab3789395 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:50.723073 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5ffe127-2165-4374-a142-f6eab3789395 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:50.723641 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5ffe127-2165-4374-a142-f6eab3789395 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:50.725141 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5ffe127-2165-4374-a142-f6eab3789395 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:50.725693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5ffe127-2165-4374-a142-f6eab3789395 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:50.899694 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f5ffe127-2165-4374-a142-f6eab3789395 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:50.907669 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f5ffe127-2165-4374-a142-f6eab3789395 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1266 microversion: 2.1 time: 0.201667 Jun 16 15:00:50.908951 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 272/545] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:50 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:51.125276 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a8f3ea61-4eae-478e-a777-43dcd839c179 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:51.125967 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a8f3ea61-4eae-478e-a777-43dcd839c179 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:51.131997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a8f3ea61-4eae-478e-a777-43dcd839c179 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:51.132512 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a8f3ea61-4eae-478e-a777-43dcd839c179 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:51.133963 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a8f3ea61-4eae-478e-a777-43dcd839c179 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:51.134422 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a8f3ea61-4eae-478e-a777-43dcd839c179 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:51.270353 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a8f3ea61-4eae-478e-a777-43dcd839c179 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:51.278523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a8f3ea61-4eae-478e-a777-43dcd839c179 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1501 microversion: 2.1 time: 0.157144 Jun 16 15:00:51.279353 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 274/546] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:51 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:51.295010 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ce37e008-dbb0-4f77-afa3-0c8a6d96208d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3654dce-0fa1-4ed9-97ef-ee54180c8217"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:51.296152 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ce37e008-dbb0-4f77-afa3-0c8a6d96208d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:51.302833 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ce37e008-dbb0-4f77-afa3-0c8a6d96208d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:51.303290 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ce37e008-dbb0-4f77-afa3-0c8a6d96208d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:51.304069 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ce37e008-dbb0-4f77-afa3-0c8a6d96208d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:51.304511 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ce37e008-dbb0-4f77-afa3-0c8a6d96208d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:51.328744 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-ce37e008-dbb0-4f77-afa3-0c8a6d96208d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] HTTP exception thrown: Cannot 'attach_volume' instance 822acf52-490b-49b9-b85f-db02cc41a0bf while it is in vm_state rescued Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ce37e008-dbb0-4f77-afa3-0c8a6d96208d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Request method failure captured: Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: POST /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf/os-volume_attachments HTTP/1.1 Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 74 Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TVCnySq6CLsGu14_jXdA3WytN6REAzlZ9z0bzJWssteHdmInuzuZUdGNc86Ke3JhB3QF1B_ZB_UdLaErT_h4DfqeItC-W52HuLPerj8sPcNbz8-ulzFH1oOz92uhvmlKKusyUoKFDiEP5YG5vAvdfYGSrhS-nVsJMhPPp4r17NoIg Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: b017c2881aba4df6afe70cdcb84d5ee8 Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1574229167 Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:00:51.330467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:00:51.332036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b017c2881aba4df6afe70cdcb84d5ee8", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b017c2881aba4df6afe70cdcb84d5ee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b017c2881aba4df6afe70cdcb84d5ee8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b017c2881aba4df6afe70cdcb84d5ee8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:00:51.332036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1574229167 Jun 16 15:00:51.332036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: b017c2881aba4df6afe70cdcb84d5ee8 Jun 16 15:00:51.332036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1574229167 Jun 16 15:00:51.332036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-ServerRescueNegativeTestJSON-1574229167-project Jun 16 15:00:51.332036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:00:51.332036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:00:51.332036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 73a51a4e876e4910bbc5dd69f8a18058 Jun 16 15:00:51.332036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1574229167-project Jun 16 15:00:51.332036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Jun 16 15:00:51.332036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {"volumeAttachment": {"volumeId": "c3654dce-0fa1-4ed9-97ef-ee54180c8217"}} Jun 16 15:00:51.332036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:00:51.333326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Cannot 'attach_volume' instance 822acf52-490b-49b9-b85f-db02cc41a0bf while it is in vm_state rescued Jun 16 15:00:51.333326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'server_id': '822acf52-490b-49b9-b85f-db02cc41a0bf', 'body': {'volumeAttachment': {'volumeId': 'c3654dce-0fa1-4ed9-97ef-ee54180c8217'}}} Jun 16 15:00:51.333326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:00:51.333326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:00:51.333326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 15:00:51.333326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 15:00:51.333326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 15:00:51.333326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 15:00:51.333326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 15:00:51.333326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 15:00:51.333326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 822acf52-490b-49b9-b85f-db02cc41a0bf in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 15:00:51.333326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:00:51.333326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:00:51.333326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:00:51.333326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:00:51.333326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:00:51.333326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:00:51.333326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:00:51.333326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:00:51.334772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:00:51.334772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:00:51.334772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 15:00:51.334772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 15:00:51.334772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 15:00:51.334772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 15:00:51.334772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 15:00:51.334772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 15:00:51.334772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 15:00:51.334772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 15:00:51.334772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 15:00:51.334772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 15:00:51.334772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 822acf52-490b-49b9-b85f-db02cc41a0bf while it is in vm_state rescued Jun 16 15:00:51.334772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:00:51.334772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:00:51.334772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:00:51.334772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:00:51.334772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:00:51.334772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:00:51.336993 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:00:51.336993 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:00:51.336993 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 822acf52-490b-49b9-b85f-db02cc41a0bf while it is in vm_state rescued Jun 16 15:00:51.336993 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:00:51.336993 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ce37e008-dbb0-4f77-afa3-0c8a6d96208d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Returning 409 to user: Cannot 'attach_volume' instance 822acf52-490b-49b9-b85f-db02cc41a0bf while it is in vm_state rescued {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:00:51.336993 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ce37e008-dbb0-4f77-afa3-0c8a6d96208d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "POST /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040886 Jun 16 15:00:51.336993 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 273/547] 10.222.0.72 () {60 vars in 1322 bytes} [Thu Jun 16 15:00:51 2022] POST /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 15:00:51.341559 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-50669a50-de60-450d-866c-dd856e2c60aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:51.342094 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-50669a50-de60-450d-866c-dd856e2c60aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:51.348221 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-50669a50-de60-450d-866c-dd856e2c60aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:51.348681 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-50669a50-de60-450d-866c-dd856e2c60aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:51.349475 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-50669a50-de60-450d-866c-dd856e2c60aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:51.349916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-50669a50-de60-450d-866c-dd856e2c60aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:51.423128 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-50669a50-de60-450d-866c-dd856e2c60aa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "POST /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf/action" status: 202 len: 0 microversion: 2.1 time: 0.085184 Jun 16 15:00:51.423764 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 275/548] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Jun 16 15:00:51 2022] POST /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 15:00:51.432356 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-298bf6c3-9ed1-494b-9950-de049daf34a7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:51.433344 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-298bf6c3-9ed1-494b-9950-de049daf34a7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:51.439601 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-298bf6c3-9ed1-494b-9950-de049daf34a7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:51.440275 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-298bf6c3-9ed1-494b-9950-de049daf34a7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:51.441320 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-298bf6c3-9ed1-494b-9950-de049daf34a7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:51.441757 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-298bf6c3-9ed1-494b-9950-de049daf34a7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:51.473895 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7a526199-7640-4b77-9590-a73096af6907 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:51.474574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7a526199-7640-4b77-9590-a73096af6907 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:51.481692 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a526199-7640-4b77-9590-a73096af6907 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:51.482137 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a526199-7640-4b77-9590-a73096af6907 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:51.482919 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a526199-7640-4b77-9590-a73096af6907 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:51.483323 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a526199-7640-4b77-9590-a73096af6907 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:51.635372 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7a526199-7640-4b77-9590-a73096af6907 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:51.643724 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7a526199-7640-4b77-9590-a73096af6907 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1314 microversion: 2.1 time: 0.173815 Jun 16 15:00:51.653023 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-298bf6c3-9ed1-494b-9950-de049daf34a7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:51.654167 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 276/549] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:51 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:51.661645 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-298bf6c3-9ed1-494b-9950-de049daf34a7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1509 microversion: 2.1 time: 0.228333 Jun 16 15:00:51.661645 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 274/550] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:51 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1509 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:51.925768 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d8245d38-7597-4b9e-9118-b678427eff60 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:51.926379 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d8245d38-7597-4b9e-9118-b678427eff60 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:51.933188 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d8245d38-7597-4b9e-9118-b678427eff60 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:51.933643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d8245d38-7597-4b9e-9118-b678427eff60 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:51.934405 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d8245d38-7597-4b9e-9118-b678427eff60 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:51.934845 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d8245d38-7597-4b9e-9118-b678427eff60 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:51.939082 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:52.081794 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d8245d38-7597-4b9e-9118-b678427eff60 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:52.089473 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d8245d38-7597-4b9e-9118-b678427eff60 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1266 microversion: 2.1 time: 0.167567 Jun 16 15:00:52.090345 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 277/551] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:51 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:52.193780 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-bac2fcc0-59c0-4994-83be-e65f779f89e8 req-7c65f029-d84e-48fa-9e25-aad13c14ef1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ea6009-6544-47c1-95bd-71542078db07", "name": "network-vif-plugged", "status": "completed", "tag": "616d7d20-0334-4e53-aae7-4c527c1c1fca"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:00:52.204942 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-bac2fcc0-59c0-4994-83be-e65f779f89e8 req-7c65f029-d84e-48fa-9e25-aad13c14ef1e service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:52.205817 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-bac2fcc0-59c0-4994-83be-e65f779f89e8 req-7c65f029-d84e-48fa-9e25-aad13c14ef1e service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:52.218085 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-bac2fcc0-59c0-4994-83be-e65f779f89e8 req-7c65f029-d84e-48fa-9e25-aad13c14ef1e service nova] Creating event network-vif-plugged:616d7d20-0334-4e53-aae7-4c527c1c1fca for instance 71ea6009-6544-47c1-95bd-71542078db07 on hv-cinder-83716 Jun 16 15:00:52.223099 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-bac2fcc0-59c0-4994-83be-e65f779f89e8 req-7c65f029-d84e-48fa-9e25-aad13c14ef1e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033049 Jun 16 15:00:52.223687 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 275/552] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:00:52.660637 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1bb5d1a1-b7b0-4276-9fb8-38e2cd49377f tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:52.661282 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1bb5d1a1-b7b0-4276-9fb8-38e2cd49377f tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:52.663110 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=4 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:52.663762 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=12 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:52.671758 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1bb5d1a1-b7b0-4276-9fb8-38e2cd49377f tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:52.672203 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1bb5d1a1-b7b0-4276-9fb8-38e2cd49377f tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:52.673016 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1bb5d1a1-b7b0-4276-9fb8-38e2cd49377f tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:52.673452 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1bb5d1a1-b7b0-4276-9fb8-38e2cd49377f tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:52.673716 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c92eefdd-5cde-4f8e-9ee0-47834fa3f6ed tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:52.674421 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c92eefdd-5cde-4f8e-9ee0-47834fa3f6ed tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:52.681646 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c92eefdd-5cde-4f8e-9ee0-47834fa3f6ed tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:52.682094 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c92eefdd-5cde-4f8e-9ee0-47834fa3f6ed tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:52.682862 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c92eefdd-5cde-4f8e-9ee0-47834fa3f6ed tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:52.683299 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c92eefdd-5cde-4f8e-9ee0-47834fa3f6ed tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:52.698556 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=4 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:52.809933 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1bb5d1a1-b7b0-4276-9fb8-38e2cd49377f tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:52.818280 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1bb5d1a1-b7b0-4276-9fb8-38e2cd49377f tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1314 microversion: 2.1 time: 0.161415 Jun 16 15:00:52.818850 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c92eefdd-5cde-4f8e-9ee0-47834fa3f6ed tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:52.819027 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 278/553] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:52 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:52.827585 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c92eefdd-5cde-4f8e-9ee0-47834fa3f6ed tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1509 microversion: 2.1 time: 0.158435 Jun 16 15:00:52.828152 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 276/554] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:52 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:53.107497 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-305ea044-dd79-47ca-8dda-3f9748e4451f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:53.108131 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-305ea044-dd79-47ca-8dda-3f9748e4451f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:53.114145 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-305ea044-dd79-47ca-8dda-3f9748e4451f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:53.114590 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-305ea044-dd79-47ca-8dda-3f9748e4451f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:53.115336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-305ea044-dd79-47ca-8dda-3f9748e4451f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:53.115771 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-305ea044-dd79-47ca-8dda-3f9748e4451f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:53.253503 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-305ea044-dd79-47ca-8dda-3f9748e4451f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:53.261836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-305ea044-dd79-47ca-8dda-3f9748e4451f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1266 microversion: 2.1 time: 0.158109 Jun 16 15:00:53.262414 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 279/555] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:53 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:53.835186 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e32e97eb-f06c-464f-b4fb-7557fbb86980 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:53.835799 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e32e97eb-f06c-464f-b4fb-7557fbb86980 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:53.843095 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e32e97eb-f06c-464f-b4fb-7557fbb86980 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:53.843551 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e32e97eb-f06c-464f-b4fb-7557fbb86980 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:53.844324 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e32e97eb-f06c-464f-b4fb-7557fbb86980 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:53.844421 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3dbef0ea-e841-412e-854a-b3746ed2836a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:53.844876 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e32e97eb-f06c-464f-b4fb-7557fbb86980 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:53.845102 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3dbef0ea-e841-412e-854a-b3746ed2836a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:53.851331 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3dbef0ea-e841-412e-854a-b3746ed2836a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:53.852366 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3dbef0ea-e841-412e-854a-b3746ed2836a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:53.853166 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3dbef0ea-e841-412e-854a-b3746ed2836a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:53.853605 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3dbef0ea-e841-412e-854a-b3746ed2836a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:53.979405 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e32e97eb-f06c-464f-b4fb-7557fbb86980 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:53.986971 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e32e97eb-f06c-464f-b4fb-7557fbb86980 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1314 microversion: 2.1 time: 0.155643 Jun 16 15:00:53.987537 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 277/556] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:53 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:53.990042 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3dbef0ea-e841-412e-854a-b3746ed2836a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:53.997873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3dbef0ea-e841-412e-854a-b3746ed2836a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1509 microversion: 2.1 time: 0.157240 Jun 16 15:00:53.998435 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 280/557] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:53 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:54.280183 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-96a62f17-8eea-4cf3-9188-69ca81843e70 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:54.280873 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-96a62f17-8eea-4cf3-9188-69ca81843e70 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:54.286999 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-96a62f17-8eea-4cf3-9188-69ca81843e70 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:54.287452 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-96a62f17-8eea-4cf3-9188-69ca81843e70 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:54.288209 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-96a62f17-8eea-4cf3-9188-69ca81843e70 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:54.288645 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-96a62f17-8eea-4cf3-9188-69ca81843e70 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:54.428801 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-96a62f17-8eea-4cf3-9188-69ca81843e70 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:54.436915 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-96a62f17-8eea-4cf3-9188-69ca81843e70 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1266 microversion: 2.1 time: 0.160992 Jun 16 15:00:54.437467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 278/558] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:54 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:55.003522 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e194c92b-9dc2-48ec-8033-a2aaeab9930e tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:55.004117 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e194c92b-9dc2-48ec-8033-a2aaeab9930e tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:55.010908 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e194c92b-9dc2-48ec-8033-a2aaeab9930e tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:55.011351 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e194c92b-9dc2-48ec-8033-a2aaeab9930e tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:55.012108 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e194c92b-9dc2-48ec-8033-a2aaeab9930e tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:55.012530 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e194c92b-9dc2-48ec-8033-a2aaeab9930e tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:55.015474 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2e9ced2a-c58b-48f9-9527-d752210b72c6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:55.016160 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2e9ced2a-c58b-48f9-9527-d752210b72c6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:55.022386 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e9ced2a-c58b-48f9-9527-d752210b72c6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:55.022868 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e9ced2a-c58b-48f9-9527-d752210b72c6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:55.023629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e9ced2a-c58b-48f9-9527-d752210b72c6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:55.024815 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e9ced2a-c58b-48f9-9527-d752210b72c6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:55.149933 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e194c92b-9dc2-48ec-8033-a2aaeab9930e tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:55.156688 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2e9ced2a-c58b-48f9-9527-d752210b72c6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:55.158659 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e194c92b-9dc2-48ec-8033-a2aaeab9930e tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1314 microversion: 2.1 time: 0.158896 Jun 16 15:00:55.159444 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 281/559] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:54 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:55.164748 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2e9ced2a-c58b-48f9-9527-d752210b72c6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1509 microversion: 2.1 time: 0.153338 Jun 16 15:00:55.165338 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 279/560] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:55 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:55.454213 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3f76d7e5-c829-48b7-b111-fa4335dceed3 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:55.454965 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3f76d7e5-c829-48b7-b111-fa4335dceed3 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:55.461148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3f76d7e5-c829-48b7-b111-fa4335dceed3 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:55.461595 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3f76d7e5-c829-48b7-b111-fa4335dceed3 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:55.462361 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3f76d7e5-c829-48b7-b111-fa4335dceed3 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:55.462801 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3f76d7e5-c829-48b7-b111-fa4335dceed3 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:55.641414 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3f76d7e5-c829-48b7-b111-fa4335dceed3 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:55.649013 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3f76d7e5-c829-48b7-b111-fa4335dceed3 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1266 microversion: 2.1 time: 0.199088 Jun 16 15:00:55.649513 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 282/561] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:55 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:56.175545 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-32a225d4-26d8-4d7e-af4c-7e158c7ee3e6 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:56.176263 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-32a225d4-26d8-4d7e-af4c-7e158c7ee3e6 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:56.180996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2bd5a996-1b6d-4a1b-8cbd-f0351cd1e8ef tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:56.182147 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2bd5a996-1b6d-4a1b-8cbd-f0351cd1e8ef tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:56.183325 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-32a225d4-26d8-4d7e-af4c-7e158c7ee3e6 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:56.183788 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-32a225d4-26d8-4d7e-af4c-7e158c7ee3e6 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:56.184586 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-32a225d4-26d8-4d7e-af4c-7e158c7ee3e6 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:56.185697 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-32a225d4-26d8-4d7e-af4c-7e158c7ee3e6 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:56.189128 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2bd5a996-1b6d-4a1b-8cbd-f0351cd1e8ef tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:56.189591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2bd5a996-1b6d-4a1b-8cbd-f0351cd1e8ef tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:56.190374 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2bd5a996-1b6d-4a1b-8cbd-f0351cd1e8ef tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:56.190811 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2bd5a996-1b6d-4a1b-8cbd-f0351cd1e8ef tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:56.341890 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-32a225d4-26d8-4d7e-af4c-7e158c7ee3e6 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:56.352868 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-32a225d4-26d8-4d7e-af4c-7e158c7ee3e6 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1314 microversion: 2.1 time: 0.181201 Jun 16 15:00:56.353117 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2bd5a996-1b6d-4a1b-8cbd-f0351cd1e8ef tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:56.360888 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 280/562] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:56 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:56.361352 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2bd5a996-1b6d-4a1b-8cbd-f0351cd1e8ef tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1509 microversion: 2.1 time: 0.184114 Jun 16 15:00:56.362073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 283/563] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:56 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:00:56.665741 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-98ccce49-9ba1-4bc4-aaad-4dae6468ec36 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:56.666621 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-98ccce49-9ba1-4bc4-aaad-4dae6468ec36 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:56.672969 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-98ccce49-9ba1-4bc4-aaad-4dae6468ec36 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:56.673423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-98ccce49-9ba1-4bc4-aaad-4dae6468ec36 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:56.674194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-98ccce49-9ba1-4bc4-aaad-4dae6468ec36 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:56.674635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-98ccce49-9ba1-4bc4-aaad-4dae6468ec36 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:56.893431 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-98ccce49-9ba1-4bc4-aaad-4dae6468ec36 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:56.901596 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-98ccce49-9ba1-4bc4-aaad-4dae6468ec36 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1266 microversion: 2.1 time: 0.240278 Jun 16 15:00:56.902159 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 281/564] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:56 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:57.369791 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d641155f-a41a-4025-8b5f-ebb65d01eeba tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:57.370476 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d641155f-a41a-4025-8b5f-ebb65d01eeba tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:57.378776 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b9c75304-5aa3-4c60-8045-684f12e8bccd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:57.379378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b9c75304-5aa3-4c60-8045-684f12e8bccd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:57.388990 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b9c75304-5aa3-4c60-8045-684f12e8bccd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:57.389440 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b9c75304-5aa3-4c60-8045-684f12e8bccd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:57.390209 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b9c75304-5aa3-4c60-8045-684f12e8bccd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:57.393507 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d641155f-a41a-4025-8b5f-ebb65d01eeba tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:57.394283 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d641155f-a41a-4025-8b5f-ebb65d01eeba tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:57.395414 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d641155f-a41a-4025-8b5f-ebb65d01eeba tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:57.396893 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d641155f-a41a-4025-8b5f-ebb65d01eeba tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:57.399204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b9c75304-5aa3-4c60-8045-684f12e8bccd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:57.582491 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b9c75304-5aa3-4c60-8045-684f12e8bccd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:57.590991 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b9c75304-5aa3-4c60-8045-684f12e8bccd tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1509 microversion: 2.1 time: 0.216138 Jun 16 15:00:57.591887 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 282/565] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:57 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1509 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:57.657604 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d641155f-a41a-4025-8b5f-ebb65d01eeba tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:57.665737 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d641155f-a41a-4025-8b5f-ebb65d01eeba tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1498 microversion: 2.1 time: 0.299791 Jun 16 15:00:57.666511 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 284/566] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:57 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1498 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:57.919211 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c0b4c3a2-ae16-4b1b-b05e-436736f5cad8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:57.919767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c0b4c3a2-ae16-4b1b-b05e-436736f5cad8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:57.943470 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c0b4c3a2-ae16-4b1b-b05e-436736f5cad8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:57.944501 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c0b4c3a2-ae16-4b1b-b05e-436736f5cad8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:57.945749 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c0b4c3a2-ae16-4b1b-b05e-436736f5cad8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:57.946897 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c0b4c3a2-ae16-4b1b-b05e-436736f5cad8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:58.135763 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c0b4c3a2-ae16-4b1b-b05e-436736f5cad8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:58.149666 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c0b4c3a2-ae16-4b1b-b05e-436736f5cad8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1266 microversion: 2.1 time: 0.232610 Jun 16 15:00:58.163105 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 283/567] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:57 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:58.316023 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-99a4bdd7-ff7d-4879-931d-65c936323cbc tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:58.316618 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-99a4bdd7-ff7d-4879-931d-65c936323cbc tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:58.323002 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-99a4bdd7-ff7d-4879-931d-65c936323cbc tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:58.323459 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-99a4bdd7-ff7d-4879-931d-65c936323cbc tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:58.324241 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-99a4bdd7-ff7d-4879-931d-65c936323cbc tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:58.324676 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-99a4bdd7-ff7d-4879-931d-65c936323cbc tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:58.351512 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-99a4bdd7-ff7d-4879-931d-65c936323cbc tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:00:58.424875 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:00:58.433001 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-99a4bdd7-ff7d-4879-931d-65c936323cbc tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "DELETE /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 204 len: 0 microversion: 2.1 time: 0.120779 Jun 16 15:00:58.433826 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 285/568] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:00:58 2022] DELETE /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:00:58.441716 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-694d5396-e1a8-4d8c-9687-4458b6a74941 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:58.442682 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-694d5396-e1a8-4d8c-9687-4458b6a74941 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:58.449131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-694d5396-e1a8-4d8c-9687-4458b6a74941 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:58.449592 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-694d5396-e1a8-4d8c-9687-4458b6a74941 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:58.450368 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-694d5396-e1a8-4d8c-9687-4458b6a74941 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:58.450810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-694d5396-e1a8-4d8c-9687-4458b6a74941 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:58.596035 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-694d5396-e1a8-4d8c-9687-4458b6a74941 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:58.606152 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-694d5396-e1a8-4d8c-9687-4458b6a74941 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1504 microversion: 2.1 time: 0.168201 Jun 16 15:00:58.606745 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 284/569] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:58 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:58.615924 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6cdc25af-b30b-459b-a6a3-363f9fb4319c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:58.615924 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6cdc25af-b30b-459b-a6a3-363f9fb4319c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:58.617406 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6cdc25af-b30b-459b-a6a3-363f9fb4319c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:58.617870 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6cdc25af-b30b-459b-a6a3-363f9fb4319c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:58.618661 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6cdc25af-b30b-459b-a6a3-363f9fb4319c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:58.619099 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6cdc25af-b30b-459b-a6a3-363f9fb4319c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:58.946824 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6cdc25af-b30b-459b-a6a3-363f9fb4319c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:58.957016 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6cdc25af-b30b-459b-a6a3-363f9fb4319c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1515 microversion: 2.1 time: 0.352050 Jun 16 15:00:58.958554 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 286/570] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:58 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1515 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:59.173274 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1b1d1823-2343-4b9c-b1dc-945a6771f729 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:59.174063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1b1d1823-2343-4b9c-b1dc-945a6771f729 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:59.181656 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1b1d1823-2343-4b9c-b1dc-945a6771f729 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:59.182336 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1b1d1823-2343-4b9c-b1dc-945a6771f729 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:59.183321 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1b1d1823-2343-4b9c-b1dc-945a6771f729 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:59.184089 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1b1d1823-2343-4b9c-b1dc-945a6771f729 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:59.423636 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1b1d1823-2343-4b9c-b1dc-945a6771f729 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:59.433889 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1b1d1823-2343-4b9c-b1dc-945a6771f729 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1266 microversion: 2.1 time: 0.267225 Jun 16 15:00:59.435087 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 285/571] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:59 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:00:59.623781 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4176cd28-96ba-4924-bfaf-e1039bf7a672 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:00:59.624385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4176cd28-96ba-4924-bfaf-e1039bf7a672 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:00:59.630800 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4176cd28-96ba-4924-bfaf-e1039bf7a672 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:59.631511 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4176cd28-96ba-4924-bfaf-e1039bf7a672 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:59.632455 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4176cd28-96ba-4924-bfaf-e1039bf7a672 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:00:59.633423 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4176cd28-96ba-4924-bfaf-e1039bf7a672 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:00:59.866339 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4176cd28-96ba-4924-bfaf-e1039bf7a672 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:00:59.876166 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4176cd28-96ba-4924-bfaf-e1039bf7a672 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1504 microversion: 2.1 time: 0.256438 Jun 16 15:00:59.877422 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 287/572] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:00:59 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1504 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:00.453989 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-265f384c-393d-4f9f-b9b8-2affc15b2cec tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:00.454671 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-265f384c-393d-4f9f-b9b8-2affc15b2cec tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:00.467955 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-265f384c-393d-4f9f-b9b8-2affc15b2cec tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:00.469016 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-265f384c-393d-4f9f-b9b8-2affc15b2cec tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:00.473030 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-265f384c-393d-4f9f-b9b8-2affc15b2cec tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:00.474345 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-265f384c-393d-4f9f-b9b8-2affc15b2cec tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:00.500083 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1f17c05c-216f-4e28-9076-a6ae34e9e43a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Action: 'create', calling method: .version_select at 0x7faab64a14c0>, body: {"keypair": {"name": "tempest-keypair-1272369815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlIWVH+GRlej1hIhkRHTIDf+9rWFaXNW6LwG24qgRWaYcGmQqIyeuOklIs3x8Hv011rTCK9dCS+jj5dONWfTtapEkSDDX5yh+FEXmxUNW2/eCZMnBhD07HiPRF9GPgvLQ=="}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:00.524937 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-1f17c05c-216f-4e28-9076-a6ae34e9e43a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Getting quotas for project b017c2881aba4df6afe70cdcb84d5ee8. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:01:00.531959 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-1f17c05c-216f-4e28-9076-a6ae34e9e43a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Getting quotas for user 73a51a4e876e4910bbc5dd69f8a18058 and project b017c2881aba4df6afe70cdcb84d5ee8. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:01:00.588135 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1f17c05c-216f-4e28-9076-a6ae34e9e43a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094328 Jun 16 15:01:00.589669 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 288/573] 10.222.0.72 () {60 vars in 1158 bytes} [Thu Jun 16 15:01:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:00.682312 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-265f384c-393d-4f9f-b9b8-2affc15b2cec tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:00.686444 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:00.692348 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-265f384c-393d-4f9f-b9b8-2affc15b2cec tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1266 microversion: 2.1 time: 0.244258 Jun 16 15:01:00.693164 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 286/574] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:00 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1266 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:00.896571 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8785a8dc-bb23-4317-bae9-17411696ca29 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:00.897216 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8785a8dc-bb23-4317-bae9-17411696ca29 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:00.909509 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8785a8dc-bb23-4317-bae9-17411696ca29 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:00.909960 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8785a8dc-bb23-4317-bae9-17411696ca29 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:00.910997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8785a8dc-bb23-4317-bae9-17411696ca29 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:00.911429 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8785a8dc-bb23-4317-bae9-17411696ca29 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:01.168590 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8785a8dc-bb23-4317-bae9-17411696ca29 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:01.178331 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8785a8dc-bb23-4317-bae9-17411696ca29 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1504 microversion: 2.1 time: 0.288176 Jun 16 15:01:01.189156 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 289/575] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:00 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1504 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:01.711280 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-03164036-a299-4378-a94d-fabfd3aefc0d tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:01.712106 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-03164036-a299-4378-a94d-fabfd3aefc0d tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:01.724421 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03164036-a299-4378-a94d-fabfd3aefc0d tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:01.726510 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03164036-a299-4378-a94d-fabfd3aefc0d tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:01.727919 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03164036-a299-4378-a94d-fabfd3aefc0d tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:01.728384 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03164036-a299-4378-a94d-fabfd3aefc0d tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:02.197094 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-77d9f26b-9218-457d-a655-445249118dd1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:02.198037 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-77d9f26b-9218-457d-a655-445249118dd1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:02.207392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-77d9f26b-9218-457d-a655-445249118dd1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:02.208179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-77d9f26b-9218-457d-a655-445249118dd1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:02.209873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-77d9f26b-9218-457d-a655-445249118dd1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:02.211756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-77d9f26b-9218-457d-a655-445249118dd1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:02.356699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-03164036-a299-4378-a94d-fabfd3aefc0d tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:02.360568 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-03164036-a299-4378-a94d-fabfd3aefc0d tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1266 microversion: 2.1 time: 0.654498 Jun 16 15:01:02.374062 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 287/576] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:01 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1266 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:02.516229 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-77d9f26b-9218-457d-a655-445249118dd1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:02.537932 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-77d9f26b-9218-457d-a655-445249118dd1 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1504 microversion: 2.1 time: 0.345319 Jun 16 15:01:02.538776 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 290/577] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:02 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1504 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:03.390598 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-82e7d256-0a1e-4f7c-8aaa-8151bd56240a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:03.392529 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-82e7d256-0a1e-4f7c-8aaa-8151bd56240a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:03.408823 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82e7d256-0a1e-4f7c-8aaa-8151bd56240a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:03.409564 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82e7d256-0a1e-4f7c-8aaa-8151bd56240a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:03.410694 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82e7d256-0a1e-4f7c-8aaa-8151bd56240a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:03.416542 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82e7d256-0a1e-4f7c-8aaa-8151bd56240a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:03.556335 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-333716fa-6464-466f-a1f9-6c01317913ce tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:03.557758 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-333716fa-6464-466f-a1f9-6c01317913ce tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:03.565531 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-333716fa-6464-466f-a1f9-6c01317913ce tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:03.566432 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-333716fa-6464-466f-a1f9-6c01317913ce tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:03.567476 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-333716fa-6464-466f-a1f9-6c01317913ce tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:03.568132 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-333716fa-6464-466f-a1f9-6c01317913ce tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:03.751410 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-82e7d256-0a1e-4f7c-8aaa-8151bd56240a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:03.765638 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-82e7d256-0a1e-4f7c-8aaa-8151bd56240a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1266 microversion: 2.1 time: 0.379461 Jun 16 15:01:03.766375 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 288/578] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:03 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1266 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:03.774593 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-a357ac3c-08a9-4642-8ea3-56f68c757008 req-82cfcf34-be3b-4c5d-b190-dd589c60826a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71ea6009-6544-47c1-95bd-71542078db07", "name": "network-vif-deleted", "tag": "616d7d20-0334-4e53-aae7-4c527c1c1fca"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:03.784339 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-a357ac3c-08a9-4642-8ea3-56f68c757008 req-82cfcf34-be3b-4c5d-b190-dd589c60826a service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:03.785207 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-a357ac3c-08a9-4642-8ea3-56f68c757008 req-82cfcf34-be3b-4c5d-b190-dd589c60826a service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:03.815082 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-a357ac3c-08a9-4642-8ea3-56f68c757008 req-82cfcf34-be3b-4c5d-b190-dd589c60826a service nova] Creating event network-vif-deleted:616d7d20-0334-4e53-aae7-4c527c1c1fca for instance 71ea6009-6544-47c1-95bd-71542078db07 on hv-cinder-83716 Jun 16 15:01:03.830568 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-a357ac3c-08a9-4642-8ea3-56f68c757008 req-82cfcf34-be3b-4c5d-b190-dd589c60826a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060464 Jun 16 15:01:03.832563 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-333716fa-6464-466f-a1f9-6c01317913ce tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aab9d86304804cb189c0c1d065d7e7b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bfa0f9f3251447c922938888ddea917', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:03.835507 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 289/579] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:03.855017 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-333716fa-6464-466f-a1f9-6c01317913ce tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 200 len: 1462 microversion: 2.1 time: 0.302053 Jun 16 15:01:03.858292 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 291/580] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:03 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 1462 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:03.907991 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-81f92cb4-130a-4640-96b8-64437e268793 req-725790ae-019b-4b90-ac6f-1ad2646babcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9376dd84-3783-460a-b0af-43ae018a961e", "name": "network-vif-plugged", "status": "completed", "tag": "01ec3b9b-b35a-4c46-8071-a79f0aa795db"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:03.922470 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-81f92cb4-130a-4640-96b8-64437e268793 req-725790ae-019b-4b90-ac6f-1ad2646babcf service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:03.922931 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-81f92cb4-130a-4640-96b8-64437e268793 req-725790ae-019b-4b90-ac6f-1ad2646babcf service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:03.946004 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-81f92cb4-130a-4640-96b8-64437e268793 req-725790ae-019b-4b90-ac6f-1ad2646babcf service nova] Creating event network-vif-plugged:01ec3b9b-b35a-4c46-8071-a79f0aa795db for instance 9376dd84-3783-460a-b0af-43ae018a961e on hv-cinder-83716 Jun 16 15:01:03.954240 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-81f92cb4-130a-4640-96b8-64437e268793 req-725790ae-019b-4b90-ac6f-1ad2646babcf service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051610 Jun 16 15:01:03.955867 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 290/581] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:01:03.993417 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-254b5fa4-2a29-4115-9379-3e5f02297d4b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-567942727", "imageRef": "23371504-a4d6-4064-90b4-87bfd0a15170", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "af6393b8-96dc-4031-aeb0-a940bd5ce30c"}], "security_groups": [{"name": "tempest-securitygroup--2002412711"}], "key_name": "tempest-keypair-1272369815", "user_data": "}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:04.215766 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.network.neutron [None req-254b5fa4-2a29-4115-9379-3e5f02297d4b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] validate_networks() for [('af6393b8-96dc-4031-aeb0-a940bd5ce30c', None, None, None, None, None)] {{(pid=124589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:01:04.811987 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d18b366b-d963-4b70-ad33-9b3f8fb0619a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:04.813930 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d18b366b-d963-4b70-ad33-9b3f8fb0619a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:04.822013 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d18b366b-d963-4b70-ad33-9b3f8fb0619a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:04.822466 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d18b366b-d963-4b70-ad33-9b3f8fb0619a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:04.823420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d18b366b-d963-4b70-ad33-9b3f8fb0619a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:04.823804 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d18b366b-d963-4b70-ad33-9b3f8fb0619a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:04.979408 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-254b5fa4-2a29-4115-9379-3e5f02297d4b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Flavor limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:01:04.981388 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-254b5fa4-2a29-4115-9379-3e5f02297d4b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Image limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:01:04.982043 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-254b5fa4-2a29-4115-9379-3e5f02297d4b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Flavor pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:01:04.982846 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-254b5fa4-2a29-4115-9379-3e5f02297d4b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Image pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:01:04.983705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-254b5fa4-2a29-4115-9379-3e5f02297d4b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:01:04.997343 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-254b5fa4-2a29-4115-9379-3e5f02297d4b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:04.998564 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-254b5fa4-2a29-4115-9379-3e5f02297d4b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:04.999969 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-254b5fa4-2a29-4115-9379-3e5f02297d4b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:05.000594 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-254b5fa4-2a29-4115-9379-3e5f02297d4b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:05.026039 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-254b5fa4-2a29-4115-9379-3e5f02297d4b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Getting quotas for project b017c2881aba4df6afe70cdcb84d5ee8. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:01:05.037512 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-254b5fa4-2a29-4115-9379-3e5f02297d4b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Getting quotas for user 73a51a4e876e4910bbc5dd69f8a18058 and project b017c2881aba4df6afe70cdcb84d5ee8. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:01:05.067414 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-254b5fa4-2a29-4115-9379-3e5f02297d4b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Going to run 1 instances... {{(pid=124589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:01:05.077610 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-254b5fa4-2a29-4115-9379-3e5f02297d4b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23371504-a4d6-4064-90b4-87bfd0a15170',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:01:05.089094 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d18b366b-d963-4b70-ad33-9b3f8fb0619a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:05.097555 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d18b366b-d963-4b70-ad33-9b3f8fb0619a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1266 microversion: 2.1 time: 0.292719 Jun 16 15:01:05.100899 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 291/582] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:04 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:05.115455 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e305b7ab-262c-4a1d-a855-2e660d34f1e3 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:05.117765 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e305b7ab-262c-4a1d-a855-2e660d34f1e3 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] [instance: 71ea6009-6544-47c1-95bd-71542078db07] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:05.137553 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e305b7ab-262c-4a1d-a855-2e660d34f1e3 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:05.138001 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e305b7ab-262c-4a1d-a855-2e660d34f1e3 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:05.138779 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e305b7ab-262c-4a1d-a855-2e660d34f1e3 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:05.139214 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e305b7ab-262c-4a1d-a855-2e660d34f1e3 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:05.173351 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-e305b7ab-262c-4a1d-a855-2e660d34f1e3 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] HTTP exception thrown: Instance 71ea6009-6544-47c1-95bd-71542078db07 could not be found. Jun 16 15:01:05.174797 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-254b5fa4-2a29-4115-9379-3e5f02297d4b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.186153 Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e305b7ab-262c-4a1d-a855-2e660d34f1e3 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Request method failure captured: Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 HTTP/1.1 Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0Vfxch2q4A-ddSWSnysAXz3mwL6A-VgzhEqKSYG9kSPDF5OCje9YunWAGSF9fkmFGPPKGkCVnha2oqj96skzPj0eQ0mKs7lJYaQ7itTuNltRUHNz9GkCmvH8jkzhS1UtH-Vdfkw3lTOZ2VEX99XYBfK8yLQHdNBxzuK-ONQOyvL3ko Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 8bfa0f9f3251447c922938888ddea917 Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-VolumesActionsTest-1903567955 Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:01:05.175098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:01:05.176891 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_8bfa0f9f3251447c922938888ddea917", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8bfa0f9f3251447c922938888ddea917"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/8bfa0f9f3251447c922938888ddea917"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/8bfa0f9f3251447c922938888ddea917"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:01:05.176891 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-VolumesActionsTest-1903567955 Jun 16 15:01:05.176891 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 8bfa0f9f3251447c922938888ddea917 Jun 16 15:01:05.176891 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-VolumesActionsTest-1903567955 Jun 16 15:01:05.176891 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-VolumesActionsTest-1903567955-project Jun 16 15:01:05.176891 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:01:05.176891 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:01:05.176891 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: aab9d86304804cb189c0c1d065d7e7b1 Jun 16 15:01:05.176891 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-VolumesActionsTest-1903567955-project Jun 16 15:01:05.176891 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:01:05.176891 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance 71ea6009-6544-47c1-95bd-71542078db07 could not be found. Jun 16 15:01:05.176891 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': '71ea6009-6544-47c1-95bd-71542078db07'} Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71ea6009-6544-47c1-95bd-71542078db07 could not be found. Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:01:05.177920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:01:05.179637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:01:05.179637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:01:05.179637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:01:05.179637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:01:05.179637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:01:05.179637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:01:05.179637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:01:05.179637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71ea6009-6544-47c1-95bd-71542078db07 could not be found. Jun 16 15:01:05.179637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:01:05.179637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:01:05.179637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:01:05.179637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:01:05.179637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:01:05.179637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:01:05.179637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:01:05.179637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:01:05.179637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71ea6009-6544-47c1-95bd-71542078db07 could not be found. Jun 16 15:01:05.179637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:01:05.180974 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e305b7ab-262c-4a1d-a855-2e660d34f1e3 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] Returning 404 to user: Instance 71ea6009-6544-47c1-95bd-71542078db07 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:01:05.185473 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e305b7ab-262c-4a1d-a855-2e660d34f1e3 tempest-VolumesActionsTest-1903567955 tempest-VolumesActionsTest-1903567955-project] 10.222.0.72 "GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07" status: 404 len: 111 microversion: 2.1 time: 0.081441 Jun 16 15:01:05.185473 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 292/583] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:05 2022] GET /compute/v2.1/servers/71ea6009-6544-47c1-95bd-71542078db07 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:01:05.186587 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 292/584] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 15:01:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 15:01:05.204711 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-81f37c88-67bc-49cd-9fb8-176dd97bc222 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:05.205836 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-81f37c88-67bc-49cd-9fb8-176dd97bc222 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:05.290606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-81f37c88-67bc-49cd-9fb8-176dd97bc222 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:05.299555 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-81f37c88-67bc-49cd-9fb8-176dd97bc222 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1245 microversion: 2.1 time: 0.100650 Jun 16 15:01:05.300141 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 293/585] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:05 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:06.120017 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-eee8c852-6f62-4f4e-95bb-d419c6beae75 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:06.134500 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-eee8c852-6f62-4f4e-95bb-d419c6beae75 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:06.174090 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eee8c852-6f62-4f4e-95bb-d419c6beae75 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:06.175546 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eee8c852-6f62-4f4e-95bb-d419c6beae75 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:06.176818 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eee8c852-6f62-4f4e-95bb-d419c6beae75 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:06.184032 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eee8c852-6f62-4f4e-95bb-d419c6beae75 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:06.316887 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c60c2932-de4d-41dd-95fd-499694f8798a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:06.317559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c60c2932-de4d-41dd-95fd-499694f8798a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:06.333532 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c60c2932-de4d-41dd-95fd-499694f8798a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:06.333991 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c60c2932-de4d-41dd-95fd-499694f8798a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:06.334794 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c60c2932-de4d-41dd-95fd-499694f8798a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:06.335240 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c60c2932-de4d-41dd-95fd-499694f8798a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:06.481356 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c60c2932-de4d-41dd-95fd-499694f8798a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:06.504112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c60c2932-de4d-41dd-95fd-499694f8798a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1249 microversion: 2.1 time: 0.190966 Jun 16 15:01:06.504708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 294/586] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:06 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1249 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:06.617314 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-eee8c852-6f62-4f4e-95bb-d419c6beae75 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:06.621499 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:06.628607 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-eee8c852-6f62-4f4e-95bb-d419c6beae75 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1266 microversion: 2.1 time: 0.517256 Jun 16 15:01:06.641376 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 293/587] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:06 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1266 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:07.534399 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-cae07c39-27c3-439f-8cd9-d273a007dc03 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:07.535799 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-cae07c39-27c3-439f-8cd9-d273a007dc03 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:07.548958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cae07c39-27c3-439f-8cd9-d273a007dc03 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:07.549999 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cae07c39-27c3-439f-8cd9-d273a007dc03 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:07.552621 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cae07c39-27c3-439f-8cd9-d273a007dc03 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:07.553449 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cae07c39-27c3-439f-8cd9-d273a007dc03 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:07.657158 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-04fd49d8-1df5-4b25-a526-9eb0c7bc702a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:07.658512 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-04fd49d8-1df5-4b25-a526-9eb0c7bc702a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:07.685402 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-cae07c39-27c3-439f-8cd9-d273a007dc03 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:07.689602 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04fd49d8-1df5-4b25-a526-9eb0c7bc702a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:07.691545 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04fd49d8-1df5-4b25-a526-9eb0c7bc702a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:07.693606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04fd49d8-1df5-4b25-a526-9eb0c7bc702a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:07.694562 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04fd49d8-1df5-4b25-a526-9eb0c7bc702a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:07.700359 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-cae07c39-27c3-439f-8cd9-d273a007dc03 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1241 microversion: 2.1 time: 0.179260 Jun 16 15:01:07.701339 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 295/588] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:07 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1241 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:07.975241 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-04fd49d8-1df5-4b25-a526-9eb0c7bc702a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:07.986311 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-04fd49d8-1df5-4b25-a526-9eb0c7bc702a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1452 microversion: 2.1 time: 0.343449 Jun 16 15:01:07.987860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 294/589] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:07 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1452 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:08.009949 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a3948f88-7be9-403c-b817-530885b1649b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:08.010802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a3948f88-7be9-403c-b817-530885b1649b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:08.019454 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a3948f88-7be9-403c-b817-530885b1649b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:08.020444 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a3948f88-7be9-403c-b817-530885b1649b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:08.021604 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a3948f88-7be9-403c-b817-530885b1649b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:08.022253 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a3948f88-7be9-403c-b817-530885b1649b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:08.304419 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a3948f88-7be9-403c-b817-530885b1649b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:08.323924 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a3948f88-7be9-403c-b817-530885b1649b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1452 microversion: 2.1 time: 0.315620 Jun 16 15:01:08.325095 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 296/590] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:08 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1452 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:08.721670 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a53c2610-5e2f-41fe-8e56-8cbeaf43b398 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:08.723120 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a53c2610-5e2f-41fe-8e56-8cbeaf43b398 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:08.738003 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a53c2610-5e2f-41fe-8e56-8cbeaf43b398 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:08.739652 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a53c2610-5e2f-41fe-8e56-8cbeaf43b398 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:08.742917 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a53c2610-5e2f-41fe-8e56-8cbeaf43b398 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:08.751448 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a53c2610-5e2f-41fe-8e56-8cbeaf43b398 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:08.885516 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a53c2610-5e2f-41fe-8e56-8cbeaf43b398 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:08.893658 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a53c2610-5e2f-41fe-8e56-8cbeaf43b398 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1241 microversion: 2.1 time: 0.176990 Jun 16 15:01:08.894895 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 295/591] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:08 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1241 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:09.927676 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e396f184-03b8-4528-bd7f-adb5095fb013 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:09.928953 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e396f184-03b8-4528-bd7f-adb5095fb013 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:09.944077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e396f184-03b8-4528-bd7f-adb5095fb013 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:09.944077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e396f184-03b8-4528-bd7f-adb5095fb013 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:09.948378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e396f184-03b8-4528-bd7f-adb5095fb013 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:09.949289 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e396f184-03b8-4528-bd7f-adb5095fb013 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:10.030416 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e396f184-03b8-4528-bd7f-adb5095fb013 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:10.042222 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e396f184-03b8-4528-bd7f-adb5095fb013 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1241 microversion: 2.1 time: 0.122891 Jun 16 15:01:10.043084 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 297/592] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:09 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1241 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:11.066979 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-53e2b4f7-4f01-49f1-9d43-6a43b32dc140 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:11.068282 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-53e2b4f7-4f01-49f1-9d43-6a43b32dc140 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:11.078763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-53e2b4f7-4f01-49f1-9d43-6a43b32dc140 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:11.081614 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-53e2b4f7-4f01-49f1-9d43-6a43b32dc140 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:11.083507 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-53e2b4f7-4f01-49f1-9d43-6a43b32dc140 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:11.086282 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-53e2b4f7-4f01-49f1-9d43-6a43b32dc140 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:11.306194 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-53e2b4f7-4f01-49f1-9d43-6a43b32dc140 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:11.324225 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-53e2b4f7-4f01-49f1-9d43-6a43b32dc140 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1241 microversion: 2.1 time: 0.264331 Jun 16 15:01:11.347245 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 296/593] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:11 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1241 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:11.369290 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-53969edc-424b-4805-af4f-14c2a0fe4887 req-778aafb2-8ece-4f45-974b-2e37db381d37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9376dd84-3783-460a-b0af-43ae018a961e", "tag": "01ec3b9b-b35a-4c46-8071-a79f0aa795db"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:11.393787 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-53969edc-424b-4805-af4f-14c2a0fe4887 req-778aafb2-8ece-4f45-974b-2e37db381d37 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:11.402908 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-53969edc-424b-4805-af4f-14c2a0fe4887 req-778aafb2-8ece-4f45-974b-2e37db381d37 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:11.441304 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-53969edc-424b-4805-af4f-14c2a0fe4887 req-778aafb2-8ece-4f45-974b-2e37db381d37 service nova] Creating event network-changed:01ec3b9b-b35a-4c46-8071-a79f0aa795db for instance 9376dd84-3783-460a-b0af-43ae018a961e on hv-cinder-83716 Jun 16 15:01:11.449947 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-53969edc-424b-4805-af4f-14c2a0fe4887 req-778aafb2-8ece-4f45-974b-2e37db381d37 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089088 Jun 16 15:01:11.453312 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 298/594] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:12.353960 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-03b3507e-9deb-40b5-813d-12e44615b404 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:12.355348 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-03b3507e-9deb-40b5-813d-12e44615b404 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:12.365058 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-03b3507e-9deb-40b5-813d-12e44615b404 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:12.367189 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-03b3507e-9deb-40b5-813d-12e44615b404 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:12.369296 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-03b3507e-9deb-40b5-813d-12e44615b404 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:12.370717 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-03b3507e-9deb-40b5-813d-12e44615b404 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:12.475222 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-03b3507e-9deb-40b5-813d-12e44615b404 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:12.484370 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-03b3507e-9deb-40b5-813d-12e44615b404 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1303 microversion: 2.1 time: 0.137663 Jun 16 15:01:12.485205 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 297/595] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:12 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1303 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:13.503771 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f73ac0f3-ad70-4792-b536-28d40b9a5953 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:13.504425 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f73ac0f3-ad70-4792-b536-28d40b9a5953 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:13.530859 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f73ac0f3-ad70-4792-b536-28d40b9a5953 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:13.535402 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f73ac0f3-ad70-4792-b536-28d40b9a5953 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:13.536128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f73ac0f3-ad70-4792-b536-28d40b9a5953 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:13.545651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f73ac0f3-ad70-4792-b536-28d40b9a5953 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:13.806677 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f73ac0f3-ad70-4792-b536-28d40b9a5953 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:13.816618 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f73ac0f3-ad70-4792-b536-28d40b9a5953 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1303 microversion: 2.1 time: 0.317644 Jun 16 15:01:13.835453 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 299/596] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:13 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1303 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:14.843045 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-bf5d6115-7b4a-41c1-8554-a36eb44b70dc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:14.844484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-bf5d6115-7b4a-41c1-8554-a36eb44b70dc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:14.859236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bf5d6115-7b4a-41c1-8554-a36eb44b70dc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:14.859700 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bf5d6115-7b4a-41c1-8554-a36eb44b70dc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:14.862800 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bf5d6115-7b4a-41c1-8554-a36eb44b70dc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:14.863245 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bf5d6115-7b4a-41c1-8554-a36eb44b70dc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:15.013796 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:15.056887 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=10 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:15.218816 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bf5d6115-7b4a-41c1-8554-a36eb44b70dc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:15.233804 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-bf5d6115-7b4a-41c1-8554-a36eb44b70dc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.394307 Jun 16 15:01:15.235613 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 298/597] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:14 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:16.253654 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-06c51c94-0c72-4077-ba5c-ee22bde29d1f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:16.255034 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-06c51c94-0c72-4077-ba5c-ee22bde29d1f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:16.258544 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:16.285943 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06c51c94-0c72-4077-ba5c-ee22bde29d1f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:16.286655 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06c51c94-0c72-4077-ba5c-ee22bde29d1f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:16.298576 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06c51c94-0c72-4077-ba5c-ee22bde29d1f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:16.299057 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06c51c94-0c72-4077-ba5c-ee22bde29d1f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:16.828060 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-06c51c94-0c72-4077-ba5c-ee22bde29d1f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:16.855085 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-06c51c94-0c72-4077-ba5c-ee22bde29d1f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.603694 Jun 16 15:01:16.876750 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 300/598] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:16 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:17.680080 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-93aa59bb-237f-41dd-b4ac-d8adbea5b022 req-bb636c99-23f5-442f-9704-4c7fb3c3c3cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c", "tag": "105d0fb0-e762-4bda-8533-5abf36bb8069"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:17.719402 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-93aa59bb-237f-41dd-b4ac-d8adbea5b022 req-bb636c99-23f5-442f-9704-4c7fb3c3c3cc service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:17.740119 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-93aa59bb-237f-41dd-b4ac-d8adbea5b022 req-bb636c99-23f5-442f-9704-4c7fb3c3c3cc service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:17.780306 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-93aa59bb-237f-41dd-b4ac-d8adbea5b022 req-bb636c99-23f5-442f-9704-4c7fb3c3c3cc service nova] Creating event network-changed:105d0fb0-e762-4bda-8533-5abf36bb8069 for instance 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c on hv-cinder-83716 Jun 16 15:01:17.804880 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-93aa59bb-237f-41dd-b4ac-d8adbea5b022 req-bb636c99-23f5-442f-9704-4c7fb3c3c3cc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133915 Jun 16 15:01:17.806237 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 299/599] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:17.885832 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4ed791f0-e3bc-4d33-b922-de9c121b2b3e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:17.887496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4ed791f0-e3bc-4d33-b922-de9c121b2b3e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:17.892731 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=70 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:17.914899 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4ed791f0-e3bc-4d33-b922-de9c121b2b3e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:17.915362 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4ed791f0-e3bc-4d33-b922-de9c121b2b3e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:17.916215 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4ed791f0-e3bc-4d33-b922-de9c121b2b3e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:17.916664 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4ed791f0-e3bc-4d33-b922-de9c121b2b3e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:18.412504 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4ed791f0-e3bc-4d33-b922-de9c121b2b3e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:18.425908 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4ed791f0-e3bc-4d33-b922-de9c121b2b3e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.545713 Jun 16 15:01:18.426843 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 301/600] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:17 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:19.446204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ff0bc55e-c7b2-4319-95ec-edd09a536846 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:19.448109 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ff0bc55e-c7b2-4319-95ec-edd09a536846 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:19.461563 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff0bc55e-c7b2-4319-95ec-edd09a536846 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:19.462595 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff0bc55e-c7b2-4319-95ec-edd09a536846 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:19.463688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff0bc55e-c7b2-4319-95ec-edd09a536846 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:19.465979 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff0bc55e-c7b2-4319-95ec-edd09a536846 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:19.772036 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ff0bc55e-c7b2-4319-95ec-edd09a536846 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:19.785015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ff0bc55e-c7b2-4319-95ec-edd09a536846 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.342418 Jun 16 15:01:19.786466 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 300/601] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:19 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:20.803252 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d24c8a31-7f57-4128-ad82-bbe06eb14209 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:20.809921 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d24c8a31-7f57-4128-ad82-bbe06eb14209 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:20.817245 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d24c8a31-7f57-4128-ad82-bbe06eb14209 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:20.817796 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d24c8a31-7f57-4128-ad82-bbe06eb14209 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:20.818658 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d24c8a31-7f57-4128-ad82-bbe06eb14209 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:20.819171 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d24c8a31-7f57-4128-ad82-bbe06eb14209 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:21.146090 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d24c8a31-7f57-4128-ad82-bbe06eb14209 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:21.156360 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d24c8a31-7f57-4128-ad82-bbe06eb14209 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.356838 Jun 16 15:01:21.193225 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 302/602] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:20 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:22.191365 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8f53e101-d6e4-434b-969d-b193fc9167ac tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:22.192333 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8f53e101-d6e4-434b-969d-b193fc9167ac tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:22.204065 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8f53e101-d6e4-434b-969d-b193fc9167ac tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:22.204892 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8f53e101-d6e4-434b-969d-b193fc9167ac tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:22.206283 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8f53e101-d6e4-434b-969d-b193fc9167ac tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:22.207071 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8f53e101-d6e4-434b-969d-b193fc9167ac tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:22.370704 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8f53e101-d6e4-434b-969d-b193fc9167ac tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:22.379247 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8f53e101-d6e4-434b-969d-b193fc9167ac tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.192289 Jun 16 15:01:22.390161 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 301/603] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:22 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:23.349461 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-12d1534f-ebd6-49a7-9898-5e428b0a755d tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Action: 'create', calling method: .version_select at 0x7faab638d040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1691632596", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiX056QoISJ0wKZ/XP8qAHiN6WXUaqszsPZk5cvmHASqS6KW414jve9B7rxNuCGeSGNz34OyFQp1QDB0RjpQNQVG07WE8lWlgcq5nnYquB14DPEMbEqI61QTFwrpymzeg=="}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:23.383351 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-12d1534f-ebd6-49a7-9898-5e428b0a755d tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Getting quotas for project 3048a9bbedf74d49a27c9911ca2ad960. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:01:23.388496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-12d1534f-ebd6-49a7-9898-5e428b0a755d tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Getting quotas for user d0b498bcfc434db99010657e2ab544b9 and project 3048a9bbedf74d49a27c9911ca2ad960. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:01:23.396663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-339b172c-8e86-4218-9e84-a9a8285889d6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:23.397301 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-339b172c-8e86-4218-9e84-a9a8285889d6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:23.405297 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-339b172c-8e86-4218-9e84-a9a8285889d6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:23.408042 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-339b172c-8e86-4218-9e84-a9a8285889d6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:23.412497 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-339b172c-8e86-4218-9e84-a9a8285889d6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:23.413126 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-339b172c-8e86-4218-9e84-a9a8285889d6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:23.415641 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-12d1534f-ebd6-49a7-9898-5e428b0a755d tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.069831 Jun 16 15:01:23.416908 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 303/604] 10.222.0.72 () {60 vars in 1158 bytes} [Thu Jun 16 15:01:23 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:23.537499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-883e5dee-4bf7-4e21-9ef5-44f6d9f02f15 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-718509993", "imageRef": "7c6ef13b-9a85-4cdb-bd4d-aa97d44b39d3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1691632596", "networks": [{"uuid": "c58a8a40-85d7-41b3-b34e-893286ec9c73"}]}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:23.570526 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-339b172c-8e86-4218-9e84-a9a8285889d6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:23.578999 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-339b172c-8e86-4218-9e84-a9a8285889d6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.186148 Jun 16 15:01:23.581949 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 302/605] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:23 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:23.635223 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-883e5dee-4bf7-4e21-9ef5-44f6d9f02f15 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] validate_networks() for [('c58a8a40-85d7-41b3-b34e-893286ec9c73', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:01:24.469742 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-883e5dee-4bf7-4e21-9ef5-44f6d9f02f15 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:01:24.471158 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-883e5dee-4bf7-4e21-9ef5-44f6d9f02f15 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:01:24.472403 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-883e5dee-4bf7-4e21-9ef5-44f6d9f02f15 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:01:24.473190 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-883e5dee-4bf7-4e21-9ef5-44f6d9f02f15 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:01:24.473996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-883e5dee-4bf7-4e21-9ef5-44f6d9f02f15 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:01:24.491174 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-883e5dee-4bf7-4e21-9ef5-44f6d9f02f15 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:24.493172 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-883e5dee-4bf7-4e21-9ef5-44f6d9f02f15 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:24.494401 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-883e5dee-4bf7-4e21-9ef5-44f6d9f02f15 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:24.495002 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-883e5dee-4bf7-4e21-9ef5-44f6d9f02f15 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:24.535634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-883e5dee-4bf7-4e21-9ef5-44f6d9f02f15 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Getting quotas for project 3048a9bbedf74d49a27c9911ca2ad960. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:01:24.541015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-883e5dee-4bf7-4e21-9ef5-44f6d9f02f15 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Getting quotas for user d0b498bcfc434db99010657e2ab544b9 and project 3048a9bbedf74d49a27c9911ca2ad960. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:01:24.557367 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-883e5dee-4bf7-4e21-9ef5-44f6d9f02f15 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:01:24.559803 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-883e5dee-4bf7-4e21-9ef5-44f6d9f02f15 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7c6ef13b-9a85-4cdb-bd4d-aa97d44b39d3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:01:24.605693 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c73d050c-cd86-432a-a6f4-4a2dff078a14 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:24.609631 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c73d050c-cd86-432a-a6f4-4a2dff078a14 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:24.613909 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-883e5dee-4bf7-4e21-9ef5-44f6d9f02f15 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.083804 Jun 16 15:01:24.614647 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 304/606] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 15:01:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 15:01:24.626027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e438e7b0-b6ef-4567-b148-b979d89fd40a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:24.626951 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e438e7b0-b6ef-4567-b148-b979d89fd40a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:24.642693 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c73d050c-cd86-432a-a6f4-4a2dff078a14 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:24.643148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c73d050c-cd86-432a-a6f4-4a2dff078a14 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:24.643935 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c73d050c-cd86-432a-a6f4-4a2dff078a14 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:24.644375 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c73d050c-cd86-432a-a6f4-4a2dff078a14 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:24.728602 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e438e7b0-b6ef-4567-b148-b979d89fd40a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:24.738121 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e438e7b0-b6ef-4567-b148-b979d89fd40a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1258 microversion: 2.1 time: 0.116145 Jun 16 15:01:24.749696 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 305/607] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:24 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1258 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:24.840116 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c73d050c-cd86-432a-a6f4-4a2dff078a14 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:24.852949 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c73d050c-cd86-432a-a6f4-4a2dff078a14 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.257185 Jun 16 15:01:24.853458 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 303/608] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:24 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:25.756167 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1e85a76f-d123-429f-bab0-fca2373f4b9f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:25.757047 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1e85a76f-d123-429f-bab0-fca2373f4b9f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:25.764930 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1e85a76f-d123-429f-bab0-fca2373f4b9f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:25.765388 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1e85a76f-d123-429f-bab0-fca2373f4b9f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:25.766199 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1e85a76f-d123-429f-bab0-fca2373f4b9f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:25.766653 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1e85a76f-d123-429f-bab0-fca2373f4b9f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:25.835296 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1e85a76f-d123-429f-bab0-fca2373f4b9f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:25.844349 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1e85a76f-d123-429f-bab0-fca2373f4b9f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1310 microversion: 2.1 time: 0.092209 Jun 16 15:01:25.845412 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 306/609] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:25 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:25.872542 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-69791701-cc82-4b5d-92bc-5f6f4d922ad6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:25.873303 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-69791701-cc82-4b5d-92bc-5f6f4d922ad6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:25.885430 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-69791701-cc82-4b5d-92bc-5f6f4d922ad6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:25.886009 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-69791701-cc82-4b5d-92bc-5f6f4d922ad6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:25.887043 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-69791701-cc82-4b5d-92bc-5f6f4d922ad6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:25.887360 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-69791701-cc82-4b5d-92bc-5f6f4d922ad6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:26.042712 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-69791701-cc82-4b5d-92bc-5f6f4d922ad6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:26.053341 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-69791701-cc82-4b5d-92bc-5f6f4d922ad6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.185453 Jun 16 15:01:26.055081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 304/610] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:25 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:26.862200 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f65a98e4-f7d2-4e38-a339-362afb507d23 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:26.863566 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f65a98e4-f7d2-4e38-a339-362afb507d23 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:26.891750 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f65a98e4-f7d2-4e38-a339-362afb507d23 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:26.898517 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f65a98e4-f7d2-4e38-a339-362afb507d23 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:26.904788 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f65a98e4-f7d2-4e38-a339-362afb507d23 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:26.906927 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f65a98e4-f7d2-4e38-a339-362afb507d23 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:27.077112 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-85ddb391-452a-4ceb-a2b5-d569c81f2615 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:27.077925 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-85ddb391-452a-4ceb-a2b5-d569c81f2615 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:27.093019 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85ddb391-452a-4ceb-a2b5-d569c81f2615 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:27.093487 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85ddb391-452a-4ceb-a2b5-d569c81f2615 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:27.094296 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85ddb391-452a-4ceb-a2b5-d569c81f2615 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:27.094732 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85ddb391-452a-4ceb-a2b5-d569c81f2615 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:27.154032 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f65a98e4-f7d2-4e38-a339-362afb507d23 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:27.167045 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f65a98e4-f7d2-4e38-a339-362afb507d23 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1316 microversion: 2.1 time: 0.308701 Jun 16 15:01:27.170524 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 307/611] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:26 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1316 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:27.177087 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-1f8b02aa-29e2-404a-939f-ced3823a4176 req-944f8cc6-186c-4ad6-a87c-e0ef5dcb15f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c", "name": "network-vif-plugged", "status": "completed", "tag": "105d0fb0-e762-4bda-8533-5abf36bb8069"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:27.203205 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-1f8b02aa-29e2-404a-939f-ced3823a4176 req-944f8cc6-186c-4ad6-a87c-e0ef5dcb15f2 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:27.204718 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-1f8b02aa-29e2-404a-939f-ced3823a4176 req-944f8cc6-186c-4ad6-a87c-e0ef5dcb15f2 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:27.256718 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-1f8b02aa-29e2-404a-939f-ced3823a4176 req-944f8cc6-186c-4ad6-a87c-e0ef5dcb15f2 service nova] Creating event network-vif-plugged:105d0fb0-e762-4bda-8533-5abf36bb8069 for instance 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c on hv-cinder-83716 Jun 16 15:01:27.275522 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-1f8b02aa-29e2-404a-939f-ced3823a4176 req-944f8cc6-186c-4ad6-a87c-e0ef5dcb15f2 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101807 Jun 16 15:01:27.277680 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 308/612] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:27.449293 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-85ddb391-452a-4ceb-a2b5-d569c81f2615 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:27.480240 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-85ddb391-452a-4ceb-a2b5-d569c81f2615 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.405621 Jun 16 15:01:27.482785 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 305/613] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:27 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:28.187213 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-303eb0f9-a06c-4ba2-b3e1-22c65c818ddf tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:28.188732 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-303eb0f9-a06c-4ba2-b3e1-22c65c818ddf tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:28.198408 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-303eb0f9-a06c-4ba2-b3e1-22c65c818ddf tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:28.199889 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-303eb0f9-a06c-4ba2-b3e1-22c65c818ddf tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:28.201526 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-303eb0f9-a06c-4ba2-b3e1-22c65c818ddf tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:28.202453 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-303eb0f9-a06c-4ba2-b3e1-22c65c818ddf tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:28.427794 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-303eb0f9-a06c-4ba2-b3e1-22c65c818ddf tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:28.451859 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-303eb0f9-a06c-4ba2-b3e1-22c65c818ddf tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.269299 Jun 16 15:01:28.452432 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 309/614] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:28 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:28.502525 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0d887596-5294-4bfe-8344-006a4b2dcf47 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:28.503527 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0d887596-5294-4bfe-8344-006a4b2dcf47 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:28.514776 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0d887596-5294-4bfe-8344-006a4b2dcf47 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:28.515767 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0d887596-5294-4bfe-8344-006a4b2dcf47 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:28.516687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0d887596-5294-4bfe-8344-006a4b2dcf47 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:28.517389 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0d887596-5294-4bfe-8344-006a4b2dcf47 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:28.751457 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0d887596-5294-4bfe-8344-006a4b2dcf47 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:28.760129 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0d887596-5294-4bfe-8344-006a4b2dcf47 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.263517 Jun 16 15:01:28.760701 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 306/615] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:28 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:29.468922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b9a97a92-6ca5-44b9-be57-c81526998cd5 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:29.470613 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b9a97a92-6ca5-44b9-be57-c81526998cd5 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:29.478755 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b9a97a92-6ca5-44b9-be57-c81526998cd5 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:29.479501 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b9a97a92-6ca5-44b9-be57-c81526998cd5 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:29.480642 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b9a97a92-6ca5-44b9-be57-c81526998cd5 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:29.481308 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b9a97a92-6ca5-44b9-be57-c81526998cd5 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:29.512372 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:29.646217 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b9a97a92-6ca5-44b9-be57-c81526998cd5 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:29.656671 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b9a97a92-6ca5-44b9-be57-c81526998cd5 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.192120 Jun 16 15:01:29.659184 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 310/616] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:29 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:29.779862 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a961b800-8884-4ff9-af02-a7c76053d79c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:29.780461 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a961b800-8884-4ff9-af02-a7c76053d79c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:29.800953 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:29.805467 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a961b800-8884-4ff9-af02-a7c76053d79c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:29.806468 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a961b800-8884-4ff9-af02-a7c76053d79c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:29.808329 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a961b800-8884-4ff9-af02-a7c76053d79c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:29.809012 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a961b800-8884-4ff9-af02-a7c76053d79c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:30.016194 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a961b800-8884-4ff9-af02-a7c76053d79c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:30.026033 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a961b800-8884-4ff9-af02-a7c76053d79c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.249100 Jun 16 15:01:30.026033 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 307/617] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:29 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:30.677190 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e8c39b04-65d5-4c8c-b8f5-ae4dc6ce8bad tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:30.678651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e8c39b04-65d5-4c8c-b8f5-ae4dc6ce8bad tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:30.689403 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e8c39b04-65d5-4c8c-b8f5-ae4dc6ce8bad tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:30.690474 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e8c39b04-65d5-4c8c-b8f5-ae4dc6ce8bad tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:30.691303 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e8c39b04-65d5-4c8c-b8f5-ae4dc6ce8bad tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:30.691921 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e8c39b04-65d5-4c8c-b8f5-ae4dc6ce8bad tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:30.857624 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e8c39b04-65d5-4c8c-b8f5-ae4dc6ce8bad tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:30.868298 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e8c39b04-65d5-4c8c-b8f5-ae4dc6ce8bad tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.196275 Jun 16 15:01:30.879099 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 311/618] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:30 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:31.042896 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b5e88302-2825-4ecf-92bf-b20129157295 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:31.043552 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b5e88302-2825-4ecf-92bf-b20129157295 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:31.050004 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b5e88302-2825-4ecf-92bf-b20129157295 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:31.050459 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b5e88302-2825-4ecf-92bf-b20129157295 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:31.051247 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b5e88302-2825-4ecf-92bf-b20129157295 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:31.051688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b5e88302-2825-4ecf-92bf-b20129157295 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:31.240252 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b5e88302-2825-4ecf-92bf-b20129157295 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:31.249143 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b5e88302-2825-4ecf-92bf-b20129157295 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.209737 Jun 16 15:01:31.250312 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 308/619] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:31 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:31.897110 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-55aef398-b339-4235-b788-edf0ac3b0874 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:31.898913 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-55aef398-b339-4235-b788-edf0ac3b0874 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:31.906199 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-55aef398-b339-4235-b788-edf0ac3b0874 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:31.906672 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-55aef398-b339-4235-b788-edf0ac3b0874 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:31.907571 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-55aef398-b339-4235-b788-edf0ac3b0874 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:31.908008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-55aef398-b339-4235-b788-edf0ac3b0874 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:32.112490 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-55aef398-b339-4235-b788-edf0ac3b0874 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:32.121965 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-55aef398-b339-4235-b788-edf0ac3b0874 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.239997 Jun 16 15:01:32.129639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 312/620] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:31 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:32.269581 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8ca8943a-2f27-4ebc-b066-1a7465e4fc6b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:32.270214 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8ca8943a-2f27-4ebc-b066-1a7465e4fc6b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:32.276936 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8ca8943a-2f27-4ebc-b066-1a7465e4fc6b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:32.277454 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8ca8943a-2f27-4ebc-b066-1a7465e4fc6b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:32.278257 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8ca8943a-2f27-4ebc-b066-1a7465e4fc6b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:32.279019 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8ca8943a-2f27-4ebc-b066-1a7465e4fc6b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:32.463127 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8ca8943a-2f27-4ebc-b066-1a7465e4fc6b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:32.478345 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8ca8943a-2f27-4ebc-b066-1a7465e4fc6b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.213127 Jun 16 15:01:32.479411 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 309/621] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:32 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:33.138721 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-446c2f6a-c4fe-41ca-bd9f-beed1ebba440 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:33.139280 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-446c2f6a-c4fe-41ca-bd9f-beed1ebba440 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:33.146762 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-446c2f6a-c4fe-41ca-bd9f-beed1ebba440 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:33.147218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-446c2f6a-c4fe-41ca-bd9f-beed1ebba440 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:33.148033 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-446c2f6a-c4fe-41ca-bd9f-beed1ebba440 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:33.148482 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-446c2f6a-c4fe-41ca-bd9f-beed1ebba440 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:33.294831 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-446c2f6a-c4fe-41ca-bd9f-beed1ebba440 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:33.302984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-446c2f6a-c4fe-41ca-bd9f-beed1ebba440 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.168128 Jun 16 15:01:33.303559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 313/622] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:33 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:33.498712 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-80653622-d2e0-4ad1-b52f-b3b766194255 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:33.500537 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-80653622-d2e0-4ad1-b52f-b3b766194255 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:33.508750 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80653622-d2e0-4ad1-b52f-b3b766194255 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:33.509350 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80653622-d2e0-4ad1-b52f-b3b766194255 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:33.510373 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80653622-d2e0-4ad1-b52f-b3b766194255 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:33.511142 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80653622-d2e0-4ad1-b52f-b3b766194255 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:33.653517 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-80653622-d2e0-4ad1-b52f-b3b766194255 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:33.661797 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-80653622-d2e0-4ad1-b52f-b3b766194255 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.169136 Jun 16 15:01:33.662367 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 310/623] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:33 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:34.325437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ee0e6d75-46f5-4457-98d1-a7f7aafe9e21 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:34.326078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ee0e6d75-46f5-4457-98d1-a7f7aafe9e21 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:34.333381 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ee0e6d75-46f5-4457-98d1-a7f7aafe9e21 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:34.333837 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ee0e6d75-46f5-4457-98d1-a7f7aafe9e21 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:34.334646 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ee0e6d75-46f5-4457-98d1-a7f7aafe9e21 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:34.335630 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ee0e6d75-46f5-4457-98d1-a7f7aafe9e21 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:34.489604 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ee0e6d75-46f5-4457-98d1-a7f7aafe9e21 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:34.498947 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ee0e6d75-46f5-4457-98d1-a7f7aafe9e21 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.178066 Jun 16 15:01:34.499784 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 314/624] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:34 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:34.679072 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-86fd3e7b-fed3-4148-aff4-87da1279cc1f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:34.679733 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-86fd3e7b-fed3-4148-aff4-87da1279cc1f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:34.687003 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-86fd3e7b-fed3-4148-aff4-87da1279cc1f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:34.687434 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-86fd3e7b-fed3-4148-aff4-87da1279cc1f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:34.688422 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-86fd3e7b-fed3-4148-aff4-87da1279cc1f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:34.688875 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-86fd3e7b-fed3-4148-aff4-87da1279cc1f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:34.693484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:34.866587 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-86fd3e7b-fed3-4148-aff4-87da1279cc1f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:34.884851 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-86fd3e7b-fed3-4148-aff4-87da1279cc1f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.209331 Jun 16 15:01:34.885798 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 311/625] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:34 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:35.517785 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fb3394eb-79fc-45f3-b097-70afbe058236 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:35.518472 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fb3394eb-79fc-45f3-b097-70afbe058236 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:35.520441 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:35.521447 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=12 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:35.527498 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb3394eb-79fc-45f3-b097-70afbe058236 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:35.527974 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb3394eb-79fc-45f3-b097-70afbe058236 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:35.528759 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb3394eb-79fc-45f3-b097-70afbe058236 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:35.529494 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb3394eb-79fc-45f3-b097-70afbe058236 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:35.911855 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2da2cf60-a67e-4f7a-9076-33dc94df637a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:35.912557 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2da2cf60-a67e-4f7a-9076-33dc94df637a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:35.922244 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2da2cf60-a67e-4f7a-9076-33dc94df637a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:35.922961 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2da2cf60-a67e-4f7a-9076-33dc94df637a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:35.923906 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2da2cf60-a67e-4f7a-9076-33dc94df637a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:35.924535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2da2cf60-a67e-4f7a-9076-33dc94df637a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:36.037199 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-fb3394eb-79fc-45f3-b097-70afbe058236 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:36.046979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fb3394eb-79fc-45f3-b097-70afbe058236 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.532239 Jun 16 15:01:36.047562 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 315/626] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:35 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:36.071664 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2da2cf60-a67e-4f7a-9076-33dc94df637a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:36.083107 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2da2cf60-a67e-4f7a-9076-33dc94df637a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.175277 Jun 16 15:01:36.084289 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 312/627] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:35 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:36.607957 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-91667b31-898f-4c73-981a-7b8f54c84a31 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:36.608531 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-91667b31-898f-4c73-981a-7b8f54c84a31 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:36.627469 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-91667b31-898f-4c73-981a-7b8f54c84a31 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:36.629318 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-91667b31-898f-4c73-981a-7b8f54c84a31 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:36.642618 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-91667b31-898f-4c73-981a-7b8f54c84a31 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:36.643436 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-91667b31-898f-4c73-981a-7b8f54c84a31 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:36.672118 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-91667b31-898f-4c73-981a-7b8f54c84a31 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/ips" status: 200 len: 152 microversion: 2.20 time: 0.068352 Jun 16 15:01:36.673065 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 316/628] 10.222.0.72 () {60 vars in 1288 bytes} [Thu Jun 16 15:01:36 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/ips => generated 152 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 15:01:37.066126 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-00b24e2b-4e0e-423f-a215-4ed55b0eeba7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:37.067809 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-00b24e2b-4e0e-423f-a215-4ed55b0eeba7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:37.078445 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-00b24e2b-4e0e-423f-a215-4ed55b0eeba7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:37.079208 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-00b24e2b-4e0e-423f-a215-4ed55b0eeba7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:37.083849 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-00b24e2b-4e0e-423f-a215-4ed55b0eeba7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:37.083849 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-00b24e2b-4e0e-423f-a215-4ed55b0eeba7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:37.101570 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-70ce0d44-e3d4-49ac-b4bf-ca1172684692 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:37.102265 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-70ce0d44-e3d4-49ac-b4bf-ca1172684692 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:37.112194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-70ce0d44-e3d4-49ac-b4bf-ca1172684692 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:37.112979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-70ce0d44-e3d4-49ac-b4bf-ca1172684692 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:37.114420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-70ce0d44-e3d4-49ac-b4bf-ca1172684692 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:37.115220 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-70ce0d44-e3d4-49ac-b4bf-ca1172684692 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:37.289250 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-00b24e2b-4e0e-423f-a215-4ed55b0eeba7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:37.297886 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-00b24e2b-4e0e-423f-a215-4ed55b0eeba7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.236165 Jun 16 15:01:37.309292 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 313/629] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:37 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:37.321083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-70ce0d44-e3d4-49ac-b4bf-ca1172684692 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:37.329582 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-70ce0d44-e3d4-49ac-b4bf-ca1172684692 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.232412 Jun 16 15:01:37.340323 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 317/630] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:37 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:38.314375 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1b336f49-ed5a-42c2-8bb0-1555e8db50b1 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:38.314992 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1b336f49-ed5a-42c2-8bb0-1555e8db50b1 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:38.320975 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b336f49-ed5a-42c2-8bb0-1555e8db50b1 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:38.321418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b336f49-ed5a-42c2-8bb0-1555e8db50b1 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:38.323849 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b336f49-ed5a-42c2-8bb0-1555e8db50b1 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:38.324278 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b336f49-ed5a-42c2-8bb0-1555e8db50b1 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:38.349783 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0b839aa1-9acb-4d70-b436-58df478fa4bf tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:38.351620 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0b839aa1-9acb-4d70-b436-58df478fa4bf tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:38.363972 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0b839aa1-9acb-4d70-b436-58df478fa4bf tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:38.367116 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0b839aa1-9acb-4d70-b436-58df478fa4bf tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:38.369841 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0b839aa1-9acb-4d70-b436-58df478fa4bf tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:38.371040 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0b839aa1-9acb-4d70-b436-58df478fa4bf tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:38.537133 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1b336f49-ed5a-42c2-8bb0-1555e8db50b1 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:38.545823 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1b336f49-ed5a-42c2-8bb0-1555e8db50b1 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.235285 Jun 16 15:01:38.546451 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 314/631] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:38 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:38.569018 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0b839aa1-9acb-4d70-b436-58df478fa4bf tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:38.577319 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0b839aa1-9acb-4d70-b436-58df478fa4bf tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.233860 Jun 16 15:01:38.577889 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 318/632] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:38 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:39.565106 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1196c0d6-2e51-4f99-8915-3000523d779b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:39.566422 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1196c0d6-2e51-4f99-8915-3000523d779b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:39.573783 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1196c0d6-2e51-4f99-8915-3000523d779b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:39.574391 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1196c0d6-2e51-4f99-8915-3000523d779b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:39.575162 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1196c0d6-2e51-4f99-8915-3000523d779b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:39.575587 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1196c0d6-2e51-4f99-8915-3000523d779b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:39.595295 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b8f54d46-6380-4a5f-a932-ffd2063e11b6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:39.596662 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b8f54d46-6380-4a5f-a932-ffd2063e11b6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:39.604279 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b8f54d46-6380-4a5f-a932-ffd2063e11b6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:39.605120 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b8f54d46-6380-4a5f-a932-ffd2063e11b6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:39.605986 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b8f54d46-6380-4a5f-a932-ffd2063e11b6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:39.606504 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b8f54d46-6380-4a5f-a932-ffd2063e11b6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:39.722665 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1196c0d6-2e51-4f99-8915-3000523d779b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:39.733371 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1196c0d6-2e51-4f99-8915-3000523d779b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.173221 Jun 16 15:01:39.733951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 315/633] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:39 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:39.743056 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-53c99c09-6e18-41a6-99dd-938124b36dbe tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:39.743989 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-53c99c09-6e18-41a6-99dd-938124b36dbe tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:39.750997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-53c99c09-6e18-41a6-99dd-938124b36dbe tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:39.751445 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-53c99c09-6e18-41a6-99dd-938124b36dbe tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:39.752425 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-53c99c09-6e18-41a6-99dd-938124b36dbe tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:39.752886 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-53c99c09-6e18-41a6-99dd-938124b36dbe tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:39.764569 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b8f54d46-6380-4a5f-a932-ffd2063e11b6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:39.773069 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b8f54d46-6380-4a5f-a932-ffd2063e11b6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.181065 Jun 16 15:01:39.773650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 319/634] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:39 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:39.782440 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-53c99c09-6e18-41a6-99dd-938124b36dbe tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lazy-loading 'flavor' on Instance uuid 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:01:40.096066 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-53c99c09-6e18-41a6-99dd-938124b36dbe tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "POST /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/action" status: 202 len: 0 microversion: 2.20 time: 0.360711 Jun 16 15:01:40.097007 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 316/635] 10.222.0.72 () {62 vars in 1318 bytes} [Thu Jun 16 15:01:39 2022] POST /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:01:40.105601 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-24213671-3820-423f-a3d9-2c3a9e9648a7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:40.106211 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-24213671-3820-423f-a3d9-2c3a9e9648a7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:40.112414 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24213671-3820-423f-a3d9-2c3a9e9648a7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:40.112963 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24213671-3820-423f-a3d9-2c3a9e9648a7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:40.113743 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24213671-3820-423f-a3d9-2c3a9e9648a7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:40.114181 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24213671-3820-423f-a3d9-2c3a9e9648a7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:40.252161 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-24213671-3820-423f-a3d9-2c3a9e9648a7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:40.260817 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-24213671-3820-423f-a3d9-2c3a9e9648a7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:40.262345 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-24213671-3820-423f-a3d9-2c3a9e9648a7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:40.263502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-24213671-3820-423f-a3d9-2c3a9e9648a7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.161861 Jun 16 15:01:40.264053 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 320/636] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:40 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:40.754616 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-39536225-c2fd-41ee-925f-55030b1394c2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:40.755392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-39536225-c2fd-41ee-925f-55030b1394c2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:40.762376 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39536225-c2fd-41ee-925f-55030b1394c2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:40.762827 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39536225-c2fd-41ee-925f-55030b1394c2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:40.763600 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39536225-c2fd-41ee-925f-55030b1394c2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:40.764032 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39536225-c2fd-41ee-925f-55030b1394c2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:40.792360 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-677ec148-d2ea-4c8b-b06d-4256e029775b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:40.793449 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-677ec148-d2ea-4c8b-b06d-4256e029775b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:40.800589 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-677ec148-d2ea-4c8b-b06d-4256e029775b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:40.801313 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-677ec148-d2ea-4c8b-b06d-4256e029775b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:40.802286 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-677ec148-d2ea-4c8b-b06d-4256e029775b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:40.802725 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-677ec148-d2ea-4c8b-b06d-4256e029775b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:40.914645 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-39536225-c2fd-41ee-925f-55030b1394c2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:40.922192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-39536225-c2fd-41ee-925f-55030b1394c2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.171947 Jun 16 15:01:40.922757 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 317/637] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:40 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:40.971501 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-677ec148-d2ea-4c8b-b06d-4256e029775b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:40.985348 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-677ec148-d2ea-4c8b-b06d-4256e029775b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.198496 Jun 16 15:01:40.986518 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 321/638] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:40 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:41.282675 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-16642f5f-2768-4e0e-971c-9c4477ebf90e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:41.283310 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-16642f5f-2768-4e0e-971c-9c4477ebf90e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:41.290081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-16642f5f-2768-4e0e-971c-9c4477ebf90e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:41.290531 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-16642f5f-2768-4e0e-971c-9c4477ebf90e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:41.291310 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-16642f5f-2768-4e0e-971c-9c4477ebf90e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:41.291769 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-16642f5f-2768-4e0e-971c-9c4477ebf90e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:41.438412 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-16642f5f-2768-4e0e-971c-9c4477ebf90e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:41.448740 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-16642f5f-2768-4e0e-971c-9c4477ebf90e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:41.450793 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-16642f5f-2768-4e0e-971c-9c4477ebf90e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:41.452292 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-16642f5f-2768-4e0e-971c-9c4477ebf90e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.173638 Jun 16 15:01:41.453202 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 318/639] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:41 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:41.941227 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1c347525-ed01-49d1-a3cd-19f9c0205373 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:41.941861 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1c347525-ed01-49d1-a3cd-19f9c0205373 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:41.949471 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1c347525-ed01-49d1-a3cd-19f9c0205373 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:41.949917 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1c347525-ed01-49d1-a3cd-19f9c0205373 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:41.950718 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1c347525-ed01-49d1-a3cd-19f9c0205373 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:41.951160 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1c347525-ed01-49d1-a3cd-19f9c0205373 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:42.008816 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-adee13c0-2fcd-4d51-b5dc-a1a3d42d1b06 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:42.009459 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-adee13c0-2fcd-4d51-b5dc-a1a3d42d1b06 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:42.015837 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-adee13c0-2fcd-4d51-b5dc-a1a3d42d1b06 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:42.016301 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-adee13c0-2fcd-4d51-b5dc-a1a3d42d1b06 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:42.017190 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-adee13c0-2fcd-4d51-b5dc-a1a3d42d1b06 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:42.017626 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-adee13c0-2fcd-4d51-b5dc-a1a3d42d1b06 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:42.127743 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1c347525-ed01-49d1-a3cd-19f9c0205373 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:42.136958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1c347525-ed01-49d1-a3cd-19f9c0205373 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.200886 Jun 16 15:01:42.137494 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 322/640] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:41 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:42.199075 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-adee13c0-2fcd-4d51-b5dc-a1a3d42d1b06 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:42.208264 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-adee13c0-2fcd-4d51-b5dc-a1a3d42d1b06 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.205885 Jun 16 15:01:42.208942 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 319/641] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:42 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:42.472005 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4f9704fe-fa86-4613-bb17-bff02aa57b09 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:42.472565 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4f9704fe-fa86-4613-bb17-bff02aa57b09 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:42.479045 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f9704fe-fa86-4613-bb17-bff02aa57b09 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:42.479498 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f9704fe-fa86-4613-bb17-bff02aa57b09 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:42.480268 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f9704fe-fa86-4613-bb17-bff02aa57b09 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:42.481280 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f9704fe-fa86-4613-bb17-bff02aa57b09 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:42.639909 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4f9704fe-fa86-4613-bb17-bff02aa57b09 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:42.649427 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4f9704fe-fa86-4613-bb17-bff02aa57b09 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:42.651071 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4f9704fe-fa86-4613-bb17-bff02aa57b09 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:42.652285 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4f9704fe-fa86-4613-bb17-bff02aa57b09 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.184479 Jun 16 15:01:42.652859 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 323/642] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:42 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:43.155483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c19ecf02-93c0-4165-9ba3-c631fb20cad5 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:43.156236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c19ecf02-93c0-4165-9ba3-c631fb20cad5 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:43.166046 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c19ecf02-93c0-4165-9ba3-c631fb20cad5 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:43.166501 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c19ecf02-93c0-4165-9ba3-c631fb20cad5 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:43.167300 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c19ecf02-93c0-4165-9ba3-c631fb20cad5 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:43.167740 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c19ecf02-93c0-4165-9ba3-c631fb20cad5 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:43.228329 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c71743fc-8cdb-4a82-a951-59983111a301 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:43.228329 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c71743fc-8cdb-4a82-a951-59983111a301 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:43.233636 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c71743fc-8cdb-4a82-a951-59983111a301 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:43.234087 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c71743fc-8cdb-4a82-a951-59983111a301 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:43.234936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c71743fc-8cdb-4a82-a951-59983111a301 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:43.235475 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c71743fc-8cdb-4a82-a951-59983111a301 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:43.347495 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c19ecf02-93c0-4165-9ba3-c631fb20cad5 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:43.357405 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c19ecf02-93c0-4165-9ba3-c631fb20cad5 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.205822 Jun 16 15:01:43.358731 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 320/643] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:43 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:43.407548 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c71743fc-8cdb-4a82-a951-59983111a301 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:43.418286 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c71743fc-8cdb-4a82-a951-59983111a301 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.195576 Jun 16 15:01:43.419560 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 324/644] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:43 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:43.673072 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fecd8ff6-f887-4db8-9d0a-bd5de5f3e813 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:43.673600 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fecd8ff6-f887-4db8-9d0a-bd5de5f3e813 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:43.679939 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fecd8ff6-f887-4db8-9d0a-bd5de5f3e813 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:43.680389 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fecd8ff6-f887-4db8-9d0a-bd5de5f3e813 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:43.681198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fecd8ff6-f887-4db8-9d0a-bd5de5f3e813 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:43.681634 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fecd8ff6-f887-4db8-9d0a-bd5de5f3e813 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:43.836063 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fecd8ff6-f887-4db8-9d0a-bd5de5f3e813 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:43.844734 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fecd8ff6-f887-4db8-9d0a-bd5de5f3e813 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:43.846276 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fecd8ff6-f887-4db8-9d0a-bd5de5f3e813 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:43.847483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fecd8ff6-f887-4db8-9d0a-bd5de5f3e813 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.178707 Jun 16 15:01:43.847997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 321/645] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:43 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:44.377513 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-85d188bf-9954-445e-a24f-d7f98c14061a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:44.378089 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-85d188bf-9954-445e-a24f-d7f98c14061a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:44.387257 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85d188bf-9954-445e-a24f-d7f98c14061a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:44.387910 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85d188bf-9954-445e-a24f-d7f98c14061a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:44.389224 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85d188bf-9954-445e-a24f-d7f98c14061a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:44.389941 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85d188bf-9954-445e-a24f-d7f98c14061a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:44.439658 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fc23f2e4-55d6-44a9-8232-bb2415ecf4e8 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:44.440642 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fc23f2e4-55d6-44a9-8232-bb2415ecf4e8 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:44.448794 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fc23f2e4-55d6-44a9-8232-bb2415ecf4e8 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:44.449279 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fc23f2e4-55d6-44a9-8232-bb2415ecf4e8 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:44.450065 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fc23f2e4-55d6-44a9-8232-bb2415ecf4e8 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:44.450501 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fc23f2e4-55d6-44a9-8232-bb2415ecf4e8 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:44.545477 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-85d188bf-9954-445e-a24f-d7f98c14061a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:44.554526 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-85d188bf-9954-445e-a24f-d7f98c14061a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.180386 Jun 16 15:01:44.555092 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 325/646] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:44 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:44.605460 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fc23f2e4-55d6-44a9-8232-bb2415ecf4e8 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:44.615177 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fc23f2e4-55d6-44a9-8232-bb2415ecf4e8 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.179406 Jun 16 15:01:44.615948 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 322/647] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:44 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:44.866636 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ced687d2-f58c-4f1d-bccc-f7fbc35d10cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:44.867536 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ced687d2-f58c-4f1d-bccc-f7fbc35d10cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:44.874646 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ced687d2-f58c-4f1d-bccc-f7fbc35d10cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:44.875102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ced687d2-f58c-4f1d-bccc-f7fbc35d10cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:44.875883 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ced687d2-f58c-4f1d-bccc-f7fbc35d10cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:44.876327 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ced687d2-f58c-4f1d-bccc-f7fbc35d10cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:45.030689 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ced687d2-f58c-4f1d-bccc-f7fbc35d10cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:45.039541 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ced687d2-f58c-4f1d-bccc-f7fbc35d10cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:45.041225 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ced687d2-f58c-4f1d-bccc-f7fbc35d10cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:45.042430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ced687d2-f58c-4f1d-bccc-f7fbc35d10cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.180282 Jun 16 15:01:45.043572 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 326/648] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:44 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:45.572309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4aaea146-a693-421f-af4f-d3586a94709c tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:45.572934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4aaea146-a693-421f-af4f-d3586a94709c tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:45.579388 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4aaea146-a693-421f-af4f-d3586a94709c tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:45.579836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4aaea146-a693-421f-af4f-d3586a94709c tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:45.580608 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4aaea146-a693-421f-af4f-d3586a94709c tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:45.581077 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4aaea146-a693-421f-af4f-d3586a94709c tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:45.636679 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d93c76e3-e1d4-4352-8491-be1e65e2f2b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:45.637509 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d93c76e3-e1d4-4352-8491-be1e65e2f2b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:45.645182 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d93c76e3-e1d4-4352-8491-be1e65e2f2b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:45.645642 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d93c76e3-e1d4-4352-8491-be1e65e2f2b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:45.646429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d93c76e3-e1d4-4352-8491-be1e65e2f2b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:45.646873 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d93c76e3-e1d4-4352-8491-be1e65e2f2b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:45.669828 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:45.725279 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4aaea146-a693-421f-af4f-d3586a94709c tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:45.736284 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4aaea146-a693-421f-af4f-d3586a94709c tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.168459 Jun 16 15:01:45.736879 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 323/649] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:45 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:45.799051 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d93c76e3-e1d4-4352-8491-be1e65e2f2b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:45.807637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d93c76e3-e1d4-4352-8491-be1e65e2f2b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.177127 Jun 16 15:01:45.808217 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 327/650] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:45 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:46.063286 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-87736532-41aa-4e65-8134-8bf6baaa0f3d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:46.064583 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-87736532-41aa-4e65-8134-8bf6baaa0f3d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:46.071523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-87736532-41aa-4e65-8134-8bf6baaa0f3d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:46.072063 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-87736532-41aa-4e65-8134-8bf6baaa0f3d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:46.073031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-87736532-41aa-4e65-8134-8bf6baaa0f3d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:46.073470 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-87736532-41aa-4e65-8134-8bf6baaa0f3d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:46.221347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-87736532-41aa-4e65-8134-8bf6baaa0f3d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:46.230192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-87736532-41aa-4e65-8134-8bf6baaa0f3d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:46.231704 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-87736532-41aa-4e65-8134-8bf6baaa0f3d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:46.232885 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-87736532-41aa-4e65-8134-8bf6baaa0f3d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.175373 Jun 16 15:01:46.233449 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 324/651] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:46 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:01:46.753781 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fab4e058-2bcb-458f-9305-5032ebf14977 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:46.754445 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fab4e058-2bcb-458f-9305-5032ebf14977 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:46.762880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fab4e058-2bcb-458f-9305-5032ebf14977 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:46.763420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fab4e058-2bcb-458f-9305-5032ebf14977 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:46.764196 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fab4e058-2bcb-458f-9305-5032ebf14977 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:46.764723 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fab4e058-2bcb-458f-9305-5032ebf14977 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:46.829982 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a3b4e145-119a-4fe3-8d2e-b5a71008c6a4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:46.831117 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a3b4e145-119a-4fe3-8d2e-b5a71008c6a4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:46.842560 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a3b4e145-119a-4fe3-8d2e-b5a71008c6a4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:46.843366 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a3b4e145-119a-4fe3-8d2e-b5a71008c6a4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:46.844786 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a3b4e145-119a-4fe3-8d2e-b5a71008c6a4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:46.845628 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a3b4e145-119a-4fe3-8d2e-b5a71008c6a4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:46.923529 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-fab4e058-2bcb-458f-9305-5032ebf14977 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:46.932482 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fab4e058-2bcb-458f-9305-5032ebf14977 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.182938 Jun 16 15:01:46.933258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 328/652] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:46 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:47.039062 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a3b4e145-119a-4fe3-8d2e-b5a71008c6a4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:47.043323 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:47.050492 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a3b4e145-119a-4fe3-8d2e-b5a71008c6a4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.227570 Jun 16 15:01:47.051076 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 325/653] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:46 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:47.253001 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-828652fd-c1ac-4854-9f7a-28b7f367a972 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:47.253513 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-828652fd-c1ac-4854-9f7a-28b7f367a972 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:47.261148 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-828652fd-c1ac-4854-9f7a-28b7f367a972 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:47.261599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-828652fd-c1ac-4854-9f7a-28b7f367a972 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:47.262378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-828652fd-c1ac-4854-9f7a-28b7f367a972 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:47.262809 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-828652fd-c1ac-4854-9f7a-28b7f367a972 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:47.409910 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-828652fd-c1ac-4854-9f7a-28b7f367a972 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:47.419407 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-828652fd-c1ac-4854-9f7a-28b7f367a972 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:47.421175 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-828652fd-c1ac-4854-9f7a-28b7f367a972 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:47.422537 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-828652fd-c1ac-4854-9f7a-28b7f367a972 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.174263 Jun 16 15:01:47.423096 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 329/654] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:47 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:47.951461 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-523d1c75-4209-4418-a62a-98f7c6272aa7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:47.952084 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-523d1c75-4209-4418-a62a-98f7c6272aa7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:47.960800 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-523d1c75-4209-4418-a62a-98f7c6272aa7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:47.961279 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-523d1c75-4209-4418-a62a-98f7c6272aa7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:47.962055 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-523d1c75-4209-4418-a62a-98f7c6272aa7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:47.962486 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-523d1c75-4209-4418-a62a-98f7c6272aa7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:48.068727 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bbe9d728-82c6-4f8d-a78c-31d88316d218 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:48.070913 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bbe9d728-82c6-4f8d-a78c-31d88316d218 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:48.077051 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:01:48.080004 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bbe9d728-82c6-4f8d-a78c-31d88316d218 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:48.081392 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bbe9d728-82c6-4f8d-a78c-31d88316d218 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:48.082591 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bbe9d728-82c6-4f8d-a78c-31d88316d218 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:48.083815 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bbe9d728-82c6-4f8d-a78c-31d88316d218 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:48.151366 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-523d1c75-4209-4418-a62a-98f7c6272aa7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:48.161323 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-523d1c75-4209-4418-a62a-98f7c6272aa7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.213593 Jun 16 15:01:48.161902 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 326/655] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:47 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:48.408972 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bbe9d728-82c6-4f8d-a78c-31d88316d218 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:48.417706 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bbe9d728-82c6-4f8d-a78c-31d88316d218 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.352997 Jun 16 15:01:48.418288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 330/656] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:48 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:48.448886 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ceb8ef82-2488-4228-ae3c-9fbb0ca6d014 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:48.449494 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ceb8ef82-2488-4228-ae3c-9fbb0ca6d014 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:48.455853 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ceb8ef82-2488-4228-ae3c-9fbb0ca6d014 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:48.456309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ceb8ef82-2488-4228-ae3c-9fbb0ca6d014 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:48.457139 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ceb8ef82-2488-4228-ae3c-9fbb0ca6d014 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:48.457749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ceb8ef82-2488-4228-ae3c-9fbb0ca6d014 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:48.607519 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ceb8ef82-2488-4228-ae3c-9fbb0ca6d014 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:48.616738 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ceb8ef82-2488-4228-ae3c-9fbb0ca6d014 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:48.618431 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ceb8ef82-2488-4228-ae3c-9fbb0ca6d014 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:48.620173 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ceb8ef82-2488-4228-ae3c-9fbb0ca6d014 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.177213 Jun 16 15:01:48.620791 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 327/657] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:48 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:01:48.965744 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-0bd44e41-4e61-44bc-a993-5b665bace434 req-06981fbf-fe0e-42ad-87eb-0fb6c0a39216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55d202da-a7dd-4ab3-8d48-fda5c914f3c8", "tag": "186c05a0-cf63-4d64-870c-57ea93435c68"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:49.005785 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-0bd44e41-4e61-44bc-a993-5b665bace434 req-06981fbf-fe0e-42ad-87eb-0fb6c0a39216 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:49.006358 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-0bd44e41-4e61-44bc-a993-5b665bace434 req-06981fbf-fe0e-42ad-87eb-0fb6c0a39216 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:49.024175 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-0bd44e41-4e61-44bc-a993-5b665bace434 req-06981fbf-fe0e-42ad-87eb-0fb6c0a39216 service nova] Creating event network-changed:186c05a0-cf63-4d64-870c-57ea93435c68 for instance 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 on hv-cinder-83716 Jun 16 15:01:49.032164 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-0bd44e41-4e61-44bc-a993-5b665bace434 req-06981fbf-fe0e-42ad-87eb-0fb6c0a39216 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073355 Jun 16 15:01:49.032991 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 331/658] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:01:49.182366 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5d876202-e59b-4b13-b366-baf4dabb15e1 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:49.183325 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5d876202-e59b-4b13-b366-baf4dabb15e1 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:49.192761 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d876202-e59b-4b13-b366-baf4dabb15e1 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:49.193580 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d876202-e59b-4b13-b366-baf4dabb15e1 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:49.195411 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d876202-e59b-4b13-b366-baf4dabb15e1 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:49.196186 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d876202-e59b-4b13-b366-baf4dabb15e1 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:49.352569 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5d876202-e59b-4b13-b366-baf4dabb15e1 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:49.360430 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5d876202-e59b-4b13-b366-baf4dabb15e1 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.185140 Jun 16 15:01:49.361042 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 328/659] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:49 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:49.436481 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fcbd68c5-93a1-4ddd-bd31-e0d4bf78ab7a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:49.437140 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fcbd68c5-93a1-4ddd-bd31-e0d4bf78ab7a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:49.443624 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fcbd68c5-93a1-4ddd-bd31-e0d4bf78ab7a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:49.444081 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fcbd68c5-93a1-4ddd-bd31-e0d4bf78ab7a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:49.445474 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fcbd68c5-93a1-4ddd-bd31-e0d4bf78ab7a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:49.445919 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fcbd68c5-93a1-4ddd-bd31-e0d4bf78ab7a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:49.636953 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-fcbd68c5-93a1-4ddd-bd31-e0d4bf78ab7a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:49.640883 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ff5fd680-b852-419c-8a68-28b0b783baaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:49.641503 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ff5fd680-b852-419c-8a68-28b0b783baaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:49.645606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fcbd68c5-93a1-4ddd-bd31-e0d4bf78ab7a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.213871 Jun 16 15:01:49.646183 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 332/660] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:49 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:49.648771 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff5fd680-b852-419c-8a68-28b0b783baaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:49.649244 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff5fd680-b852-419c-8a68-28b0b783baaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:49.650010 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff5fd680-b852-419c-8a68-28b0b783baaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:49.650437 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff5fd680-b852-419c-8a68-28b0b783baaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:49.786681 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ff5fd680-b852-419c-8a68-28b0b783baaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:49.795033 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ff5fd680-b852-419c-8a68-28b0b783baaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:49.796541 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ff5fd680-b852-419c-8a68-28b0b783baaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:49.797752 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ff5fd680-b852-419c-8a68-28b0b783baaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.162131 Jun 16 15:01:49.798317 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 329/661] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:49 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:50.378492 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6fd32f7a-a9b5-40c0-9e3a-1aadadfe181f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:50.379094 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6fd32f7a-a9b5-40c0-9e3a-1aadadfe181f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:50.385252 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6fd32f7a-a9b5-40c0-9e3a-1aadadfe181f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:50.385695 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6fd32f7a-a9b5-40c0-9e3a-1aadadfe181f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:50.386528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6fd32f7a-a9b5-40c0-9e3a-1aadadfe181f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:50.386958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6fd32f7a-a9b5-40c0-9e3a-1aadadfe181f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:50.600930 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6fd32f7a-a9b5-40c0-9e3a-1aadadfe181f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:50.609519 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6fd32f7a-a9b5-40c0-9e3a-1aadadfe181f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.235048 Jun 16 15:01:50.610205 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 333/662] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:50 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:50.664992 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-95e97d95-4ad3-4874-9704-f0449535a387 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:50.665545 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-95e97d95-4ad3-4874-9704-f0449535a387 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:50.672016 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-95e97d95-4ad3-4874-9704-f0449535a387 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:50.672469 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-95e97d95-4ad3-4874-9704-f0449535a387 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:50.673275 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-95e97d95-4ad3-4874-9704-f0449535a387 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:50.673801 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-95e97d95-4ad3-4874-9704-f0449535a387 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:50.815766 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f5459258-509e-40ea-aa79-ecfdee243592 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:50.816503 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f5459258-509e-40ea-aa79-ecfdee243592 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:50.816867 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-95e97d95-4ad3-4874-9704-f0449535a387 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:50.823600 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5459258-509e-40ea-aa79-ecfdee243592 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:50.824053 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5459258-509e-40ea-aa79-ecfdee243592 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:50.825061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-95e97d95-4ad3-4874-9704-f0449535a387 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1371 microversion: 2.1 time: 0.164587 Jun 16 15:01:50.825419 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5459258-509e-40ea-aa79-ecfdee243592 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:50.833074 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5459258-509e-40ea-aa79-ecfdee243592 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:50.833281 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 330/663] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:50 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:50.974925 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f5459258-509e-40ea-aa79-ecfdee243592 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:50.984359 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f5459258-509e-40ea-aa79-ecfdee243592 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:50.985930 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f5459258-509e-40ea-aa79-ecfdee243592 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:50.987131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f5459258-509e-40ea-aa79-ecfdee243592 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.175438 Jun 16 15:01:50.987709 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 334/664] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:50 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:51.627177 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-48615a8c-14b5-468f-9611-4205798556d2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:51.627935 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-48615a8c-14b5-468f-9611-4205798556d2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:51.635768 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-48615a8c-14b5-468f-9611-4205798556d2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:51.636278 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-48615a8c-14b5-468f-9611-4205798556d2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:51.637369 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-48615a8c-14b5-468f-9611-4205798556d2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:51.637894 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-48615a8c-14b5-468f-9611-4205798556d2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:51.843652 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-437bf945-8f83-4ffe-b2b8-9526a18a2684 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:51.844321 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-437bf945-8f83-4ffe-b2b8-9526a18a2684 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:51.853102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-437bf945-8f83-4ffe-b2b8-9526a18a2684 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:51.853882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-437bf945-8f83-4ffe-b2b8-9526a18a2684 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:51.855310 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-437bf945-8f83-4ffe-b2b8-9526a18a2684 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:51.856522 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-437bf945-8f83-4ffe-b2b8-9526a18a2684 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:51.877245 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-48615a8c-14b5-468f-9611-4205798556d2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:51.890892 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-48615a8c-14b5-468f-9611-4205798556d2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.266786 Jun 16 15:01:51.894997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 331/665] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:51 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:52.006604 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4544a8ff-ddb4-417b-8351-781413ac9a54 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:52.006604 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4544a8ff-ddb4-417b-8351-781413ac9a54 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:52.013197 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4544a8ff-ddb4-417b-8351-781413ac9a54 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:52.013641 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4544a8ff-ddb4-417b-8351-781413ac9a54 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:52.014412 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4544a8ff-ddb4-417b-8351-781413ac9a54 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:52.014839 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4544a8ff-ddb4-417b-8351-781413ac9a54 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:52.173846 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4544a8ff-ddb4-417b-8351-781413ac9a54 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:52.186050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4544a8ff-ddb4-417b-8351-781413ac9a54 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:52.187601 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4544a8ff-ddb4-417b-8351-781413ac9a54 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:52.189368 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4544a8ff-ddb4-417b-8351-781413ac9a54 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.187284 Jun 16 15:01:52.189854 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 332/666] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:52 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:01:52.193244 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-437bf945-8f83-4ffe-b2b8-9526a18a2684 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:52.208213 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-437bf945-8f83-4ffe-b2b8-9526a18a2684 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1565 microversion: 2.1 time: 0.369284 Jun 16 15:01:52.208872 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 335/667] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:51 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1565 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:52.226946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-af11c655-1ac6-4c8b-b080-c9a1137ef4a8 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:52.227445 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-af11c655-1ac6-4c8b-b080-c9a1137ef4a8 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:52.234704 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af11c655-1ac6-4c8b-b080-c9a1137ef4a8 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:52.235184 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af11c655-1ac6-4c8b-b080-c9a1137ef4a8 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:52.235972 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af11c655-1ac6-4c8b-b080-c9a1137ef4a8 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:52.236412 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af11c655-1ac6-4c8b-b080-c9a1137ef4a8 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:52.359298 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-af11c655-1ac6-4c8b-b080-c9a1137ef4a8 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137429 Jun 16 15:01:52.359907 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 333/668] 10.222.0.72 () {58 vars in 1274 bytes} [Thu Jun 16 15:01:52 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:52.912051 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3ebfafe0-644a-4251-86fc-aa10a23e3e04 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:52.912793 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3ebfafe0-644a-4251-86fc-aa10a23e3e04 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:52.920561 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ebfafe0-644a-4251-86fc-aa10a23e3e04 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:52.921041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ebfafe0-644a-4251-86fc-aa10a23e3e04 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:52.921819 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ebfafe0-644a-4251-86fc-aa10a23e3e04 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:52.922251 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ebfafe0-644a-4251-86fc-aa10a23e3e04 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:53.065481 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3ebfafe0-644a-4251-86fc-aa10a23e3e04 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:53.073941 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3ebfafe0-644a-4251-86fc-aa10a23e3e04 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.165876 Jun 16 15:01:53.074531 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 336/669] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:52 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:53.210384 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f1f35d0b-2f77-4ca3-a9c6-0ee91e05086a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:53.211602 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f1f35d0b-2f77-4ca3-a9c6-0ee91e05086a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:53.218489 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f1f35d0b-2f77-4ca3-a9c6-0ee91e05086a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:53.218943 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f1f35d0b-2f77-4ca3-a9c6-0ee91e05086a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:53.219714 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f1f35d0b-2f77-4ca3-a9c6-0ee91e05086a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:53.220140 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f1f35d0b-2f77-4ca3-a9c6-0ee91e05086a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:53.454802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f1f35d0b-2f77-4ca3-a9c6-0ee91e05086a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:53.463748 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f1f35d0b-2f77-4ca3-a9c6-0ee91e05086a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:53.465287 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f1f35d0b-2f77-4ca3-a9c6-0ee91e05086a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:53.466477 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f1f35d0b-2f77-4ca3-a9c6-0ee91e05086a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.260720 Jun 16 15:01:53.467047 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 334/670] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:53 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:01:53.530335 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-8face8d6-7928-49ce-8fff-f8eea0f8dee8 req-0e075a26-803f-4c57-921d-73871455df52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c", "tag": "105d0fb0-e762-4bda-8533-5abf36bb8069"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:53.538756 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-8face8d6-7928-49ce-8fff-f8eea0f8dee8 req-0e075a26-803f-4c57-921d-73871455df52 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:53.539200 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-8face8d6-7928-49ce-8fff-f8eea0f8dee8 req-0e075a26-803f-4c57-921d-73871455df52 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:53.551205 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-8face8d6-7928-49ce-8fff-f8eea0f8dee8 req-0e075a26-803f-4c57-921d-73871455df52 service nova] Creating event network-changed:105d0fb0-e762-4bda-8533-5abf36bb8069 for instance 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c on hv-cinder-83716 Jun 16 15:01:53.556563 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-8face8d6-7928-49ce-8fff-f8eea0f8dee8 req-0e075a26-803f-4c57-921d-73871455df52 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030402 Jun 16 15:01:53.557416 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 337/671] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:01:54.091839 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a948e07b-a1db-4573-9c30-1eb300faa609 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:54.092458 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a948e07b-a1db-4573-9c30-1eb300faa609 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:54.099375 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a948e07b-a1db-4573-9c30-1eb300faa609 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:54.099826 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a948e07b-a1db-4573-9c30-1eb300faa609 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:54.101169 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a948e07b-a1db-4573-9c30-1eb300faa609 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:54.101609 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a948e07b-a1db-4573-9c30-1eb300faa609 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:54.247298 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a948e07b-a1db-4573-9c30-1eb300faa609 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:54.255058 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a948e07b-a1db-4573-9c30-1eb300faa609 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.167147 Jun 16 15:01:54.255631 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 335/672] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:54 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:54.487856 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1725906e-1b20-4936-923f-f8c10acef114 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:54.488548 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1725906e-1b20-4936-923f-f8c10acef114 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:54.495726 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1725906e-1b20-4936-923f-f8c10acef114 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:54.496323 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1725906e-1b20-4936-923f-f8c10acef114 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:54.497169 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1725906e-1b20-4936-923f-f8c10acef114 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:54.497677 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1725906e-1b20-4936-923f-f8c10acef114 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:54.647029 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1725906e-1b20-4936-923f-f8c10acef114 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:54.655658 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1725906e-1b20-4936-923f-f8c10acef114 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:54.657288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1725906e-1b20-4936-923f-f8c10acef114 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:54.658506 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1725906e-1b20-4936-923f-f8c10acef114 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.175565 Jun 16 15:01:54.659293 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 338/673] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:54 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:55.272914 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6ad8a53b-2188-4a20-98ac-4135e65203fe tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:55.273557 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6ad8a53b-2188-4a20-98ac-4135e65203fe tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:55.280551 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6ad8a53b-2188-4a20-98ac-4135e65203fe tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:55.281204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6ad8a53b-2188-4a20-98ac-4135e65203fe tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:55.281983 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6ad8a53b-2188-4a20-98ac-4135e65203fe tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:55.282429 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6ad8a53b-2188-4a20-98ac-4135e65203fe tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:55.428364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6ad8a53b-2188-4a20-98ac-4135e65203fe tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:55.436470 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6ad8a53b-2188-4a20-98ac-4135e65203fe tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.167853 Jun 16 15:01:55.437081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 336/674] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:55 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:55.677831 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e4cb4f83-7103-4a6a-8d34-bfa60f89b7cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:55.678421 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e4cb4f83-7103-4a6a-8d34-bfa60f89b7cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:55.685602 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e4cb4f83-7103-4a6a-8d34-bfa60f89b7cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:55.686093 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e4cb4f83-7103-4a6a-8d34-bfa60f89b7cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:55.686906 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e4cb4f83-7103-4a6a-8d34-bfa60f89b7cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:55.687390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e4cb4f83-7103-4a6a-8d34-bfa60f89b7cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:55.935922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e4cb4f83-7103-4a6a-8d34-bfa60f89b7cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:55.945222 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e4cb4f83-7103-4a6a-8d34-bfa60f89b7cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:55.946996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e4cb4f83-7103-4a6a-8d34-bfa60f89b7cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:55.948705 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e4cb4f83-7103-4a6a-8d34-bfa60f89b7cb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.274804 Jun 16 15:01:55.949330 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 339/675] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:55 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:01:56.454198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-dbde0ec0-db9c-4279-812f-80a2a5bfa599 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:56.454747 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-dbde0ec0-db9c-4279-812f-80a2a5bfa599 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:56.460988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dbde0ec0-db9c-4279-812f-80a2a5bfa599 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:56.461438 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dbde0ec0-db9c-4279-812f-80a2a5bfa599 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:56.462210 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dbde0ec0-db9c-4279-812f-80a2a5bfa599 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:56.462651 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dbde0ec0-db9c-4279-812f-80a2a5bfa599 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:56.600908 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-dbde0ec0-db9c-4279-812f-80a2a5bfa599 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:56.609386 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-dbde0ec0-db9c-4279-812f-80a2a5bfa599 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.159446 Jun 16 15:01:56.609949 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 337/676] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:56 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:56.743855 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-447f2983-decb-4a11-9823-c13e85c6fda4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:56.744395 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-447f2983-decb-4a11-9823-c13e85c6fda4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:56.754287 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-447f2983-decb-4a11-9823-c13e85c6fda4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:56.755109 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-447f2983-decb-4a11-9823-c13e85c6fda4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:56.756535 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-447f2983-decb-4a11-9823-c13e85c6fda4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:56.757384 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-447f2983-decb-4a11-9823-c13e85c6fda4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:56.796517 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-447f2983-decb-4a11-9823-c13e85c6fda4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7/ips" status: 200 len: 151 microversion: 2.1 time: 0.056341 Jun 16 15:01:56.797610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 340/677] 10.222.0.72 () {58 vars in 1247 bytes} [Thu Jun 16 15:01:56 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7/ips => generated 151 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:01:56.967314 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e0fba901-45a7-4268-83e4-fd235e248e42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:56.967915 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e0fba901-45a7-4268-83e4-fd235e248e42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:56.975268 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e0fba901-45a7-4268-83e4-fd235e248e42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:56.975811 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e0fba901-45a7-4268-83e4-fd235e248e42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:56.976596 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e0fba901-45a7-4268-83e4-fd235e248e42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:56.977083 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e0fba901-45a7-4268-83e4-fd235e248e42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:57.162042 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e0fba901-45a7-4268-83e4-fd235e248e42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:57.170869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e0fba901-45a7-4268-83e4-fd235e248e42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:57.172383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e0fba901-45a7-4268-83e4-fd235e248e42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:57.173633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e0fba901-45a7-4268-83e4-fd235e248e42 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.210452 Jun 16 15:01:57.181701 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 338/678] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:56 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:01:57.626666 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-04aae6e0-56c1-4325-b234-8bae1b97d67d tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:57.627278 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-04aae6e0-56c1-4325-b234-8bae1b97d67d tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:57.634412 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-04aae6e0-56c1-4325-b234-8bae1b97d67d tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:57.634866 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-04aae6e0-56c1-4325-b234-8bae1b97d67d tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:57.635648 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-04aae6e0-56c1-4325-b234-8bae1b97d67d tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:57.636087 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-04aae6e0-56c1-4325-b234-8bae1b97d67d tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:57.823229 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-04aae6e0-56c1-4325-b234-8bae1b97d67d tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:57.833575 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-f81f711a-a587-4a31-97d7-39a9f4174589 req-be8324e2-b94f-43f3-86d4-c4e7fd8902ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55d202da-a7dd-4ab3-8d48-fda5c914f3c8", "name": "network-vif-plugged", "status": "completed", "tag": "186c05a0-cf63-4d64-870c-57ea93435c68"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:57.835259 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-04aae6e0-56c1-4325-b234-8bae1b97d67d tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.212291 Jun 16 15:01:57.835838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 341/679] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:57 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:01:57.853481 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-f81f711a-a587-4a31-97d7-39a9f4174589 req-be8324e2-b94f-43f3-86d4-c4e7fd8902ec service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:57.853915 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-f81f711a-a587-4a31-97d7-39a9f4174589 req-be8324e2-b94f-43f3-86d4-c4e7fd8902ec service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:57.866406 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-f81f711a-a587-4a31-97d7-39a9f4174589 req-be8324e2-b94f-43f3-86d4-c4e7fd8902ec service nova] Creating event network-vif-plugged:186c05a0-cf63-4d64-870c-57ea93435c68 for instance 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 on hv-cinder-83716 Jun 16 15:01:57.874768 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-f81f711a-a587-4a31-97d7-39a9f4174589 req-be8324e2-b94f-43f3-86d4-c4e7fd8902ec service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045919 Jun 16 15:01:57.875702 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 339/680] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:01:58.192251 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b209b53e-5631-4ac0-b170-c9d26f2ff4ab tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:58.192939 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b209b53e-5631-4ac0-b170-c9d26f2ff4ab tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:58.199401 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b209b53e-5631-4ac0-b170-c9d26f2ff4ab tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:58.199857 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b209b53e-5631-4ac0-b170-c9d26f2ff4ab tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:58.200833 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b209b53e-5631-4ac0-b170-c9d26f2ff4ab tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:58.201297 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b209b53e-5631-4ac0-b170-c9d26f2ff4ab tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:58.360159 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b209b53e-5631-4ac0-b170-c9d26f2ff4ab tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:58.369564 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b209b53e-5631-4ac0-b170-c9d26f2ff4ab tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:58.371063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b209b53e-5631-4ac0-b170-c9d26f2ff4ab tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:58.372255 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b209b53e-5631-4ac0-b170-c9d26f2ff4ab tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.184352 Jun 16 15:01:58.372812 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 342/681] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:58 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:01:58.853074 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-36e733ba-cc69-4235-aee2-2d5b22323241 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:58.853780 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-36e733ba-cc69-4235-aee2-2d5b22323241 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:58.860238 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-36e733ba-cc69-4235-aee2-2d5b22323241 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:58.860688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-36e733ba-cc69-4235-aee2-2d5b22323241 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:58.861502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-36e733ba-cc69-4235-aee2-2d5b22323241 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:58.861934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-36e733ba-cc69-4235-aee2-2d5b22323241 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:59.003118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-36e733ba-cc69-4235-aee2-2d5b22323241 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:59.011325 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-36e733ba-cc69-4235-aee2-2d5b22323241 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.162547 Jun 16 15:01:59.011901 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 340/682] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:01:58 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:01:59.270344 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ad9fce49-277a-4f2b-bf85-a1e0dcaba99b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6e8f3dc-47cf-43ad-a5a1-136b787019ea"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:01:59.271485 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ad9fce49-277a-4f2b-bf85-a1e0dcaba99b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:59.279706 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ad9fce49-277a-4f2b-bf85-a1e0dcaba99b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:59.280323 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ad9fce49-277a-4f2b-bf85-a1e0dcaba99b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:59.281279 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ad9fce49-277a-4f2b-bf85-a1e0dcaba99b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:59.281719 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ad9fce49-277a-4f2b-bf85-a1e0dcaba99b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:59.391336 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d6a02b41-15f1-44dc-b006-815e3c6ba79f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:01:59.391939 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d6a02b41-15f1-44dc-b006-815e3c6ba79f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:01:59.399029 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d6a02b41-15f1-44dc-b006-815e3c6ba79f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:59.399477 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d6a02b41-15f1-44dc-b006-815e3c6ba79f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:59.400239 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d6a02b41-15f1-44dc-b006-815e3c6ba79f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:01:59.400698 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d6a02b41-15f1-44dc-b006-815e3c6ba79f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:01:59.545009 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d6a02b41-15f1-44dc-b006-815e3c6ba79f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:59.556967 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d6a02b41-15f1-44dc-b006-815e3c6ba79f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:59.558477 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d6a02b41-15f1-44dc-b006-815e3c6ba79f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:01:59.559650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d6a02b41-15f1-44dc-b006-815e3c6ba79f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.172233 Jun 16 15:01:59.560198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 341/683] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:01:59 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:00.031053 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d0170f77-2a90-420d-8161-c245b0f824b8 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:00.031749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d0170f77-2a90-420d-8161-c245b0f824b8 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:00.033815 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=70 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:00.040118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d0170f77-2a90-420d-8161-c245b0f824b8 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:00.040571 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d0170f77-2a90-420d-8161-c245b0f824b8 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:00.041381 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d0170f77-2a90-420d-8161-c245b0f824b8 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:00.041816 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d0170f77-2a90-420d-8161-c245b0f824b8 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:00.186385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d0170f77-2a90-420d-8161-c245b0f824b8 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:00.194486 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d0170f77-2a90-420d-8161-c245b0f824b8 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1358 microversion: 2.1 time: 0.170244 Jun 16 15:02:00.195057 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 342/684] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:00 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:00.578681 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-80118bb5-7233-47a0-a9bc-6cbd8d4f9c27 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:00.579296 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-80118bb5-7233-47a0-a9bc-6cbd8d4f9c27 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:00.586689 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80118bb5-7233-47a0-a9bc-6cbd8d4f9c27 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:00.587134 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80118bb5-7233-47a0-a9bc-6cbd8d4f9c27 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:00.587912 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80118bb5-7233-47a0-a9bc-6cbd8d4f9c27 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:00.588349 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80118bb5-7233-47a0-a9bc-6cbd8d4f9c27 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:00.607834 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:00.735794 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-80118bb5-7233-47a0-a9bc-6cbd8d4f9c27 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:00.746153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-80118bb5-7233-47a0-a9bc-6cbd8d4f9c27 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:00.747795 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-80118bb5-7233-47a0-a9bc-6cbd8d4f9c27 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:00.748987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-80118bb5-7233-47a0-a9bc-6cbd8d4f9c27 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.174211 Jun 16 15:02:00.749552 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 343/685] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:00 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:01.211424 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3fc0fda4-fdf3-4deb-b428-9bd1048ea72f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:01.212085 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3fc0fda4-fdf3-4deb-b428-9bd1048ea72f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:01.218585 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3fc0fda4-fdf3-4deb-b428-9bd1048ea72f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:01.219045 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3fc0fda4-fdf3-4deb-b428-9bd1048ea72f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:01.219816 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3fc0fda4-fdf3-4deb-b428-9bd1048ea72f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:01.220253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3fc0fda4-fdf3-4deb-b428-9bd1048ea72f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:01.593966 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3fc0fda4-fdf3-4deb-b428-9bd1048ea72f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:01.602711 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3fc0fda4-fdf3-4deb-b428-9bd1048ea72f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1548 microversion: 2.1 time: 0.395020 Jun 16 15:02:01.603569 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 344/686] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:01 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1548 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:02:01.621860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-85b3a89e-d2b2-4c35-8463-5250f67a47dc tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:01.622789 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-85b3a89e-d2b2-4c35-8463-5250f67a47dc tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:01.635151 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85b3a89e-d2b2-4c35-8463-5250f67a47dc tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:01.636036 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85b3a89e-d2b2-4c35-8463-5250f67a47dc tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:01.637382 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85b3a89e-d2b2-4c35-8463-5250f67a47dc tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:01.637816 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85b3a89e-d2b2-4c35-8463-5250f67a47dc tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:01.770914 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ad9fce49-277a-4f2b-bf85-a1e0dcaba99b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "POST /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.504229 Jun 16 15:02:01.772029 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 343/687] 10.222.0.72 () {60 vars in 1322 bytes} [Thu Jun 16 15:01:59 2022] POST /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7/os-volume_attachments => generated 194 bytes in 2506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:01.797016 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4e238b1e-7315-49bc-9cc1-b966cda85af9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:01.798559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4e238b1e-7315-49bc-9cc1-b966cda85af9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:01.807199 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4e238b1e-7315-49bc-9cc1-b966cda85af9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:01.807915 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4e238b1e-7315-49bc-9cc1-b966cda85af9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:01.809008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4e238b1e-7315-49bc-9cc1-b966cda85af9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:01.809605 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4e238b1e-7315-49bc-9cc1-b966cda85af9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:01.830272 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-85b3a89e-d2b2-4c35-8463-5250f67a47dc tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:01.832707 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:01.857227 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-85b3a89e-d2b2-4c35-8463-5250f67a47dc tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1548 microversion: 2.1 time: 0.237945 Jun 16 15:02:01.859861 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 345/688] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:01 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1548 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:02:01.891817 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7053c8d2-d59f-4a3a-8019-a69215e735be tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:01.897065 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7053c8d2-d59f-4a3a-8019-a69215e735be tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:01.898335 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7053c8d2-d59f-4a3a-8019-a69215e735be tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Searching by: {'deleted': False, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960'} {{(pid=124589) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 15:02:01.907645 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7053c8d2-d59f-4a3a-8019-a69215e735be tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:01.908349 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7053c8d2-d59f-4a3a-8019-a69215e735be tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:01.909402 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7053c8d2-d59f-4a3a-8019-a69215e735be tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:01.909998 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7053c8d2-d59f-4a3a-8019-a69215e735be tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:02.001672 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4e238b1e-7315-49bc-9cc1-b966cda85af9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:02.011714 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4e238b1e-7315-49bc-9cc1-b966cda85af9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:02.018887 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4e238b1e-7315-49bc-9cc1-b966cda85af9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:02.020214 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4e238b1e-7315-49bc-9cc1-b966cda85af9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1745 microversion: 2.20 time: 0.246386 Jun 16 15:02:02.020354 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.multi_cell_list [None req-7053c8d2-d59f-4a3a-8019-a69215e735be tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 15:02:02.021696 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 344/689] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:01 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1745 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:02.121573 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7053c8d2-d59f-4a3a-8019-a69215e735be tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.242384 Jun 16 15:02:02.122080 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 346/690] 10.222.0.72 () {58 vars in 1124 bytes} [Thu Jun 16 15:02:01 2022] GET /compute/v2.1/servers => generated 342 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:02.132690 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1af5c024-3d46-40bd-aa65-a24aa2a1a211 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:02.133517 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1af5c024-3d46-40bd-aa65-a24aa2a1a211 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:02.142363 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1af5c024-3d46-40bd-aa65-a24aa2a1a211 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:02.143165 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1af5c024-3d46-40bd-aa65-a24aa2a1a211 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:02.144115 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1af5c024-3d46-40bd-aa65-a24aa2a1a211 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:02.144739 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1af5c024-3d46-40bd-aa65-a24aa2a1a211 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:02.300096 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1af5c024-3d46-40bd-aa65-a24aa2a1a211 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:02.311059 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1af5c024-3d46-40bd-aa65-a24aa2a1a211 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1548 microversion: 2.1 time: 0.182072 Jun 16 15:02:02.312008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 345/691] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:02 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1548 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:03.040774 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8a8b211a-ce71-4dc9-9292-bf50a85a8868 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:03.041524 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8a8b211a-ce71-4dc9-9292-bf50a85a8868 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:03.047660 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a8b211a-ce71-4dc9-9292-bf50a85a8868 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:03.048108 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a8b211a-ce71-4dc9-9292-bf50a85a8868 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:03.048901 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a8b211a-ce71-4dc9-9292-bf50a85a8868 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:03.049353 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a8b211a-ce71-4dc9-9292-bf50a85a8868 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:03.199509 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8a8b211a-ce71-4dc9-9292-bf50a85a8868 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:03.208270 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8a8b211a-ce71-4dc9-9292-bf50a85a8868 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:03.209837 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8a8b211a-ce71-4dc9-9292-bf50a85a8868 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:03.211548 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8a8b211a-ce71-4dc9-9292-bf50a85a8868 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1745 microversion: 2.20 time: 0.175370 Jun 16 15:02:03.212100 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 347/692] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:03 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:03.820041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-0db2217a-61c5-473c-9155-4949cd60e41c req-67e55e17-6a0e-4d7e-af34-1ad89d2b1444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9", "name": "network-vif-plugged", "status": "completed", "tag": "4a15d94a-43cc-45b4-89d5-3b8cdc6c8c65"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:03.830442 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-0db2217a-61c5-473c-9155-4949cd60e41c req-67e55e17-6a0e-4d7e-af34-1ad89d2b1444 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:03.830900 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-0db2217a-61c5-473c-9155-4949cd60e41c req-67e55e17-6a0e-4d7e-af34-1ad89d2b1444 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:03.843584 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-0db2217a-61c5-473c-9155-4949cd60e41c req-67e55e17-6a0e-4d7e-af34-1ad89d2b1444 service nova] Creating event network-vif-plugged:4a15d94a-43cc-45b4-89d5-3b8cdc6c8c65 for instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 on hv-cinder-83716 Jun 16 15:02:03.848622 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-0db2217a-61c5-473c-9155-4949cd60e41c req-67e55e17-6a0e-4d7e-af34-1ad89d2b1444 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034178 Jun 16 15:02:03.849431 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 346/693] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:04.231842 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-61654e21-7f60-4651-8521-db2a5bb34239 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:04.232384 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-61654e21-7f60-4651-8521-db2a5bb34239 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:04.238673 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-61654e21-7f60-4651-8521-db2a5bb34239 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:04.239267 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-61654e21-7f60-4651-8521-db2a5bb34239 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:04.240519 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-61654e21-7f60-4651-8521-db2a5bb34239 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:04.241289 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-61654e21-7f60-4651-8521-db2a5bb34239 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:04.385490 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-61654e21-7f60-4651-8521-db2a5bb34239 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:04.394022 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-61654e21-7f60-4651-8521-db2a5bb34239 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:04.395531 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-61654e21-7f60-4651-8521-db2a5bb34239 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:04.396705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-61654e21-7f60-4651-8521-db2a5bb34239 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1745 microversion: 2.20 time: 0.169784 Jun 16 15:02:04.397868 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 348/694] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:04 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:04.921916 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-df15ffa1-413f-423c-b9af-7ffad598f20a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "99b8a2b2-f026-4839-aa93-3e0476c5473d"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:04.923061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-df15ffa1-413f-423c-b9af-7ffad598f20a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:04.930257 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-df15ffa1-413f-423c-b9af-7ffad598f20a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:04.930703 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-df15ffa1-413f-423c-b9af-7ffad598f20a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:04.931475 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-df15ffa1-413f-423c-b9af-7ffad598f20a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:04.931904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-df15ffa1-413f-423c-b9af-7ffad598f20a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:05.232996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-df15ffa1-413f-423c-b9af-7ffad598f20a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "POST /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311353 Jun 16 15:02:05.232996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 347/695] 10.222.0.72 () {60 vars in 1322 bytes} [Thu Jun 16 15:02:04 2022] POST /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:05.416092 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-01b00072-242d-49f2-be4a-60cebb222327 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:05.416707 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-01b00072-242d-49f2-be4a-60cebb222327 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:05.423229 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-01b00072-242d-49f2-be4a-60cebb222327 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:05.423684 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-01b00072-242d-49f2-be4a-60cebb222327 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:05.424457 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-01b00072-242d-49f2-be4a-60cebb222327 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:05.424924 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-01b00072-242d-49f2-be4a-60cebb222327 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:05.560927 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-01b00072-242d-49f2-be4a-60cebb222327 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:05.569498 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-01b00072-242d-49f2-be4a-60cebb222327 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:05.571151 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-01b00072-242d-49f2-be4a-60cebb222327 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:05.572510 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-01b00072-242d-49f2-be4a-60cebb222327 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1745 microversion: 2.20 time: 0.160783 Jun 16 15:02:05.573126 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 349/696] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:05 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:06.591542 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2351605c-275c-419f-a1a0-3cf385981b72 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:06.592161 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2351605c-275c-419f-a1a0-3cf385981b72 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:06.598544 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2351605c-275c-419f-a1a0-3cf385981b72 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:06.598991 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2351605c-275c-419f-a1a0-3cf385981b72 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:06.599765 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2351605c-275c-419f-a1a0-3cf385981b72 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:06.600207 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2351605c-275c-419f-a1a0-3cf385981b72 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:06.738847 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2351605c-275c-419f-a1a0-3cf385981b72 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:06.747677 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2351605c-275c-419f-a1a0-3cf385981b72 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:06.749210 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2351605c-275c-419f-a1a0-3cf385981b72 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:06.750387 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2351605c-275c-419f-a1a0-3cf385981b72 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1745 microversion: 2.20 time: 0.163802 Jun 16 15:02:06.750945 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 348/697] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:06 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:07.769551 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-535497bb-2d82-4765-9891-8b65ef143ce1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:07.770126 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-535497bb-2d82-4765-9891-8b65ef143ce1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:07.776333 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-535497bb-2d82-4765-9891-8b65ef143ce1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:07.776781 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-535497bb-2d82-4765-9891-8b65ef143ce1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:07.777576 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-535497bb-2d82-4765-9891-8b65ef143ce1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:07.778014 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-535497bb-2d82-4765-9891-8b65ef143ce1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:07.916461 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-535497bb-2d82-4765-9891-8b65ef143ce1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:07.924671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-535497bb-2d82-4765-9891-8b65ef143ce1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:07.926259 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-535497bb-2d82-4765-9891-8b65ef143ce1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:07.927414 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-535497bb-2d82-4765-9891-8b65ef143ce1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1745 microversion: 2.20 time: 0.161852 Jun 16 15:02:07.927963 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 350/698] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:07 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:08.946090 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-52b6e6cb-8049-4990-a7da-b089e1cf1769 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:08.946775 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-52b6e6cb-8049-4990-a7da-b089e1cf1769 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:08.953602 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-52b6e6cb-8049-4990-a7da-b089e1cf1769 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:08.954051 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-52b6e6cb-8049-4990-a7da-b089e1cf1769 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:08.954815 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-52b6e6cb-8049-4990-a7da-b089e1cf1769 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:08.955254 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-52b6e6cb-8049-4990-a7da-b089e1cf1769 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:09.249930 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-52b6e6cb-8049-4990-a7da-b089e1cf1769 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:09.258684 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-52b6e6cb-8049-4990-a7da-b089e1cf1769 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:09.260168 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-52b6e6cb-8049-4990-a7da-b089e1cf1769 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:09.261345 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-52b6e6cb-8049-4990-a7da-b089e1cf1769 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1745 microversion: 2.20 time: 0.319167 Jun 16 15:02:09.261895 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 349/699] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:08 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1745 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:10.280673 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e3a81abb-3b40-4632-8e8c-0e632c96e395 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:10.281566 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e3a81abb-3b40-4632-8e8c-0e632c96e395 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:10.288485 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e3a81abb-3b40-4632-8e8c-0e632c96e395 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:10.288956 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e3a81abb-3b40-4632-8e8c-0e632c96e395 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:10.289738 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e3a81abb-3b40-4632-8e8c-0e632c96e395 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:10.290221 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e3a81abb-3b40-4632-8e8c-0e632c96e395 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:10.503678 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-40cbf5fa-2941-4d7b-be80-67a70704772b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Action: 'create', calling method: .version_select at 0x7faab638d700>, body: {"keypair": {"name": "tempest-keypair-886657474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiDkMcZKoH2a7p1hVHO7WfQJPmA5ALlE44wNMZlZknv9bwBGYl/Nbg+yygOa6jEARA6HYx+GD95f6Gpl1sLcHYBg0xBEMCn71zXoaPTtX1lRkMaz4iqFUv62YGYY0jaSA=="}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:10.545819 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-40cbf5fa-2941-4d7b-be80-67a70704772b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Getting quotas for project 2940b81a86c2401db1aa432d9a0735eb. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:02:10.552669 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-40cbf5fa-2941-4d7b-be80-67a70704772b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Getting quotas for user 0b8be0ab53ae48af844bc281dee5f77c and project 2940b81a86c2401db1aa432d9a0735eb. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:02:10.586538 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-40cbf5fa-2941-4d7b-be80-67a70704772b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.099983 Jun 16 15:02:10.588099 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 350/700] 10.222.0.72 () {60 vars in 1158 bytes} [Thu Jun 16 15:02:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:02:10.602101 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e3a81abb-3b40-4632-8e8c-0e632c96e395 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:10.626248 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e3a81abb-3b40-4632-8e8c-0e632c96e395 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:10.627760 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e3a81abb-3b40-4632-8e8c-0e632c96e395 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:10.629197 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e3a81abb-3b40-4632-8e8c-0e632c96e395 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1740 microversion: 2.20 time: 0.353195 Jun 16 15:02:10.629922 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 351/701] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:10 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1740 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:11.659730 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a385a7e8-ef31-4250-ac44-018d37d52ef6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:11.663787 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a385a7e8-ef31-4250-ac44-018d37d52ef6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:11.707838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a385a7e8-ef31-4250-ac44-018d37d52ef6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:11.715382 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a385a7e8-ef31-4250-ac44-018d37d52ef6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:11.717759 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a385a7e8-ef31-4250-ac44-018d37d52ef6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:11.719924 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a385a7e8-ef31-4250-ac44-018d37d52ef6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:11.967075 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a385a7e8-ef31-4250-ac44-018d37d52ef6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:11.978709 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a385a7e8-ef31-4250-ac44-018d37d52ef6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:11.980677 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a385a7e8-ef31-4250-ac44-018d37d52ef6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:11.981935 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a385a7e8-ef31-4250-ac44-018d37d52ef6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1740 microversion: 2.20 time: 0.333917 Jun 16 15:02:11.982495 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 351/702] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:11 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1740 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:12.971027 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-aa048782-f474-4962-aa2a-ec812892512a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-495543711", "imageRef": "23371504-a4d6-4064-90b4-87bfd0a15170", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "585283c3-d940-441f-ba61-bbe0dfecbee8"}], "security_groups": [{"name": "tempest-securitygroup--160095436"}], "key_name": "tempest-keypair-886657474", "user_data": "}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:12.979981 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:13.001338 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-be0d0704-c0a1-4eda-9529-3a11c6411918 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:13.001954 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-be0d0704-c0a1-4eda-9529-3a11c6411918 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:13.010015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-be0d0704-c0a1-4eda-9529-3a11c6411918 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:13.010675 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-be0d0704-c0a1-4eda-9529-3a11c6411918 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:13.011698 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-be0d0704-c0a1-4eda-9529-3a11c6411918 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:13.012283 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-be0d0704-c0a1-4eda-9529-3a11c6411918 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:13.101686 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.network.neutron [None req-aa048782-f474-4962-aa2a-ec812892512a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] validate_networks() for [('585283c3-d940-441f-ba61-bbe0dfecbee8', None, None, None, None, None)] {{(pid=124589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:02:13.416593 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-be0d0704-c0a1-4eda-9529-3a11c6411918 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:13.433528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-be0d0704-c0a1-4eda-9529-3a11c6411918 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:13.435614 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-be0d0704-c0a1-4eda-9529-3a11c6411918 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:13.437344 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-be0d0704-c0a1-4eda-9529-3a11c6411918 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1740 microversion: 2.20 time: 0.440066 Jun 16 15:02:13.438115 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 352/703] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:12 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1740 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:13.545909 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-aa048782-f474-4962-aa2a-ec812892512a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Flavor limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:02:13.546456 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-aa048782-f474-4962-aa2a-ec812892512a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Image limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:02:13.547010 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-aa048782-f474-4962-aa2a-ec812892512a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Flavor pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:02:13.547498 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-aa048782-f474-4962-aa2a-ec812892512a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Image pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:02:13.548152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-aa048782-f474-4962-aa2a-ec812892512a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:02:13.566708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aa048782-f474-4962-aa2a-ec812892512a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:13.567263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aa048782-f474-4962-aa2a-ec812892512a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:13.568121 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aa048782-f474-4962-aa2a-ec812892512a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:13.568625 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aa048782-f474-4962-aa2a-ec812892512a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:13.587168 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-aa048782-f474-4962-aa2a-ec812892512a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Getting quotas for project 2940b81a86c2401db1aa432d9a0735eb. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:02:13.591692 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-aa048782-f474-4962-aa2a-ec812892512a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Getting quotas for user 0b8be0ab53ae48af844bc281dee5f77c and project 2940b81a86c2401db1aa432d9a0735eb. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:02:13.603441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-aa048782-f474-4962-aa2a-ec812892512a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Going to run 1 instances... {{(pid=124589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:02:13.605832 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-aa048782-f474-4962-aa2a-ec812892512a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23371504-a4d6-4064-90b4-87bfd0a15170',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:02:13.665609 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-aa048782-f474-4962-aa2a-ec812892512a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.699613 Jun 16 15:02:13.666473 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 352/704] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 15:02:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 15:02:13.676789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6a35ab0a-72d2-4d4c-a8f7-3964b09b6e2f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:13.678044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6a35ab0a-72d2-4d4c-a8f7-3964b09b6e2f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:13.750734 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6a35ab0a-72d2-4d4c-a8f7-3964b09b6e2f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:13.757890 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6a35ab0a-72d2-4d4c-a8f7-3964b09b6e2f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 200 len: 1240 microversion: 2.1 time: 0.085218 Jun 16 15:02:13.758468 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 353/705] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:13 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:14.456887 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7532ffb7-7964-4641-aa7e-6784c4d821bb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:14.457712 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7532ffb7-7964-4641-aa7e-6784c4d821bb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:14.465576 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7532ffb7-7964-4641-aa7e-6784c4d821bb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:14.466348 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7532ffb7-7964-4641-aa7e-6784c4d821bb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:14.467667 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7532ffb7-7964-4641-aa7e-6784c4d821bb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:14.468343 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7532ffb7-7964-4641-aa7e-6784c4d821bb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:14.632560 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7532ffb7-7964-4641-aa7e-6784c4d821bb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:14.640768 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7532ffb7-7964-4641-aa7e-6784c4d821bb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:14.642300 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7532ffb7-7964-4641-aa7e-6784c4d821bb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:14.643460 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7532ffb7-7964-4641-aa7e-6784c4d821bb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1740 microversion: 2.20 time: 0.191288 Jun 16 15:02:14.644005 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 353/706] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:14 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:14.775530 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-21731766-29c0-43f5-a857-c0ffa1f8b9a5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:14.776187 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-21731766-29c0-43f5-a857-c0ffa1f8b9a5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:14.783661 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-21731766-29c0-43f5-a857-c0ffa1f8b9a5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:14.784509 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-21731766-29c0-43f5-a857-c0ffa1f8b9a5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:14.785706 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-21731766-29c0-43f5-a857-c0ffa1f8b9a5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:14.786390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-21731766-29c0-43f5-a857-c0ffa1f8b9a5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:14.862461 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-21731766-29c0-43f5-a857-c0ffa1f8b9a5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:14.871977 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-21731766-29c0-43f5-a857-c0ffa1f8b9a5 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 200 len: 1292 microversion: 2.1 time: 0.100218 Jun 16 15:02:14.873639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 354/707] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:14 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 1292 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:02:15.663647 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ef8d4492-3cfb-4cca-937a-7612ffaa2073 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:15.665128 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ef8d4492-3cfb-4cca-937a-7612ffaa2073 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:15.679972 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ef8d4492-3cfb-4cca-937a-7612ffaa2073 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:15.681171 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ef8d4492-3cfb-4cca-937a-7612ffaa2073 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:15.683729 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ef8d4492-3cfb-4cca-937a-7612ffaa2073 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:15.684189 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ef8d4492-3cfb-4cca-937a-7612ffaa2073 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:15.891277 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ef8d4492-3cfb-4cca-937a-7612ffaa2073 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:15.902005 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-69f67734-ca04-45f0-8b60-a33e3f2515c4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:15.903721 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ef8d4492-3cfb-4cca-937a-7612ffaa2073 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:15.904127 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-69f67734-ca04-45f0-8b60-a33e3f2515c4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:15.905984 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ef8d4492-3cfb-4cca-937a-7612ffaa2073 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:15.907550 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ef8d4492-3cfb-4cca-937a-7612ffaa2073 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1740 microversion: 2.20 time: 0.249175 Jun 16 15:02:15.908230 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 354/708] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:15 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:15.915102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-69f67734-ca04-45f0-8b60-a33e3f2515c4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:15.917237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-69f67734-ca04-45f0-8b60-a33e3f2515c4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:15.919236 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-69f67734-ca04-45f0-8b60-a33e3f2515c4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:15.920039 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-69f67734-ca04-45f0-8b60-a33e3f2515c4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:16.026179 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-69f67734-ca04-45f0-8b60-a33e3f2515c4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:16.035495 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-69f67734-ca04-45f0-8b60-a33e3f2515c4 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 200 len: 1298 microversion: 2.1 time: 0.144397 Jun 16 15:02:16.036072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 355/709] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:15 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 1298 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:16.929189 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ce2b366f-7a09-48e5-b55a-45e172194b0a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:16.930630 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ce2b366f-7a09-48e5-b55a-45e172194b0a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:16.937839 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce2b366f-7a09-48e5-b55a-45e172194b0a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:16.938880 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce2b366f-7a09-48e5-b55a-45e172194b0a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:16.939876 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce2b366f-7a09-48e5-b55a-45e172194b0a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:16.940416 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce2b366f-7a09-48e5-b55a-45e172194b0a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:17.066592 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0dbc8c9e-0612-4c03-b636-af4348b1e73e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:17.067674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0dbc8c9e-0612-4c03-b636-af4348b1e73e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:17.088986 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0dbc8c9e-0612-4c03-b636-af4348b1e73e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:17.091300 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0dbc8c9e-0612-4c03-b636-af4348b1e73e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:17.092547 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0dbc8c9e-0612-4c03-b636-af4348b1e73e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:17.093211 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0dbc8c9e-0612-4c03-b636-af4348b1e73e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:17.406924 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ce2b366f-7a09-48e5-b55a-45e172194b0a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:17.417466 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ce2b366f-7a09-48e5-b55a-45e172194b0a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:17.423789 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ce2b366f-7a09-48e5-b55a-45e172194b0a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:17.425371 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ce2b366f-7a09-48e5-b55a-45e172194b0a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1740 microversion: 2.20 time: 0.500774 Jun 16 15:02:17.426422 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 355/710] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:16 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1740 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:17.493597 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0dbc8c9e-0612-4c03-b636-af4348b1e73e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:17.509121 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0dbc8c9e-0612-4c03-b636-af4348b1e73e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 200 len: 1365 microversion: 2.1 time: 0.451672 Jun 16 15:02:17.512597 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 356/711] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:17 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 1365 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:17.622748 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-8c2183e0-8f82-444f-bfc8-f04c4e2c7910 req-74389393-2ddc-4854-a418-b1a9ad9a2da4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6a310ce-a575-4379-9390-2b4ad718e3ed", "tag": "81f49aec-659a-46a4-b41a-827750fcd2ce"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:17.638501 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-8c2183e0-8f82-444f-bfc8-f04c4e2c7910 req-74389393-2ddc-4854-a418-b1a9ad9a2da4 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:17.639298 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-8c2183e0-8f82-444f-bfc8-f04c4e2c7910 req-74389393-2ddc-4854-a418-b1a9ad9a2da4 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:17.655495 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-8c2183e0-8f82-444f-bfc8-f04c4e2c7910 req-74389393-2ddc-4854-a418-b1a9ad9a2da4 service nova] Creating event network-changed:81f49aec-659a-46a4-b41a-827750fcd2ce for instance a6a310ce-a575-4379-9390-2b4ad718e3ed on hv-cinder-83716 Jun 16 15:02:17.663069 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-8c2183e0-8f82-444f-bfc8-f04c4e2c7910 req-74389393-2ddc-4854-a418-b1a9ad9a2da4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048445 Jun 16 15:02:17.664183 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 356/712] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:18.444636 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e516a189-0546-4a96-9ea2-0899024d3746 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:18.446229 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e516a189-0546-4a96-9ea2-0899024d3746 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:18.450355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:18.456474 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e516a189-0546-4a96-9ea2-0899024d3746 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:18.457305 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e516a189-0546-4a96-9ea2-0899024d3746 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:18.458393 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e516a189-0546-4a96-9ea2-0899024d3746 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:18.459108 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e516a189-0546-4a96-9ea2-0899024d3746 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:18.478693 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0f52a95f-daec-4abc-8fe2-732ebd396571 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:18.479542 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0f52a95f-daec-4abc-8fe2-732ebd396571 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:18.486112 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f52a95f-daec-4abc-8fe2-732ebd396571 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:18.486559 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f52a95f-daec-4abc-8fe2-732ebd396571 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:18.487341 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f52a95f-daec-4abc-8fe2-732ebd396571 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:18.487767 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f52a95f-daec-4abc-8fe2-732ebd396571 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:18.625733 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e516a189-0546-4a96-9ea2-0899024d3746 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:18.634963 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e516a189-0546-4a96-9ea2-0899024d3746 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:18.636616 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e516a189-0546-4a96-9ea2-0899024d3746 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:18.637837 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e516a189-0546-4a96-9ea2-0899024d3746 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1740 microversion: 2.20 time: 0.197875 Jun 16 15:02:18.638594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 357/713] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:18 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:18.643327 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-351899d6-fe77-419e-ab1b-b34aad76aa1e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:18.643923 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-351899d6-fe77-419e-ab1b-b34aad76aa1e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:18.650983 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-351899d6-fe77-419e-ab1b-b34aad76aa1e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:18.651598 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-351899d6-fe77-419e-ab1b-b34aad76aa1e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:18.652467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-351899d6-fe77-419e-ab1b-b34aad76aa1e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:18.652960 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-351899d6-fe77-419e-ab1b-b34aad76aa1e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:18.659385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0f52a95f-daec-4abc-8fe2-732ebd396571 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:18.667273 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0f52a95f-daec-4abc-8fe2-732ebd396571 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1594 microversion: 2.1 time: 0.192725 Jun 16 15:02:18.668265 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 357/714] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:18 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1594 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:02:18.870231 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-351899d6-fe77-419e-ab1b-b34aad76aa1e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:18.879656 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-351899d6-fe77-419e-ab1b-b34aad76aa1e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 200 len: 1365 microversion: 2.1 time: 0.239768 Jun 16 15:02:18.880973 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 358/715] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:18 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:19.657326 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-624ba24f-5044-4d5b-8c8b-900b5c80f6f3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:19.658779 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-624ba24f-5044-4d5b-8c8b-900b5c80f6f3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:19.667346 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-624ba24f-5044-4d5b-8c8b-900b5c80f6f3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:19.668098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-624ba24f-5044-4d5b-8c8b-900b5c80f6f3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:19.669062 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-624ba24f-5044-4d5b-8c8b-900b5c80f6f3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:19.669715 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-624ba24f-5044-4d5b-8c8b-900b5c80f6f3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:19.902091 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-39edfbc3-1989-4fe4-b40e-c54be9795fa9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:19.903101 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-39edfbc3-1989-4fe4-b40e-c54be9795fa9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:19.930967 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-39edfbc3-1989-4fe4-b40e-c54be9795fa9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:19.931448 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-39edfbc3-1989-4fe4-b40e-c54be9795fa9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:19.932435 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-39edfbc3-1989-4fe4-b40e-c54be9795fa9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:19.933085 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-39edfbc3-1989-4fe4-b40e-c54be9795fa9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:19.972905 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-624ba24f-5044-4d5b-8c8b-900b5c80f6f3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:19.983691 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-624ba24f-5044-4d5b-8c8b-900b5c80f6f3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:19.986656 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-624ba24f-5044-4d5b-8c8b-900b5c80f6f3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:19.991800 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-624ba24f-5044-4d5b-8c8b-900b5c80f6f3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1740 microversion: 2.20 time: 0.338127 Jun 16 15:02:19.998444 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 358/716] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:19 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1740 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:20.152480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-39edfbc3-1989-4fe4-b40e-c54be9795fa9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:20.163362 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-39edfbc3-1989-4fe4-b40e-c54be9795fa9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 200 len: 1365 microversion: 2.1 time: 0.267136 Jun 16 15:02:20.177560 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 359/717] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:19 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:21.018150 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3bcdb7ae-2dbe-4f7f-baf1-83d3133d3b37 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:21.018954 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3bcdb7ae-2dbe-4f7f-baf1-83d3133d3b37 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:21.027580 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3bcdb7ae-2dbe-4f7f-baf1-83d3133d3b37 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:21.028078 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3bcdb7ae-2dbe-4f7f-baf1-83d3133d3b37 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:21.028919 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3bcdb7ae-2dbe-4f7f-baf1-83d3133d3b37 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:21.029371 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3bcdb7ae-2dbe-4f7f-baf1-83d3133d3b37 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:21.049810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-e44daaa9-0875-4110-8633-7b03d4905c96 req-cfd9210d-a290-476e-b089-26e196cbe336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55d202da-a7dd-4ab3-8d48-fda5c914f3c8", "tag": "186c05a0-cf63-4d64-870c-57ea93435c68"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:21.073797 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-e44daaa9-0875-4110-8633-7b03d4905c96 req-cfd9210d-a290-476e-b089-26e196cbe336 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:21.074508 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-e44daaa9-0875-4110-8633-7b03d4905c96 req-cfd9210d-a290-476e-b089-26e196cbe336 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:21.099792 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-e44daaa9-0875-4110-8633-7b03d4905c96 req-cfd9210d-a290-476e-b089-26e196cbe336 service nova] Creating event network-changed:186c05a0-cf63-4d64-870c-57ea93435c68 for instance 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 on hv-cinder-83716 Jun 16 15:02:21.105936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-e44daaa9-0875-4110-8633-7b03d4905c96 req-cfd9210d-a290-476e-b089-26e196cbe336 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060740 Jun 16 15:02:21.106829 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 360/718] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:21.192684 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e84ddde0-864d-4599-9984-3d8973d4fc8e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:21.194174 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e84ddde0-864d-4599-9984-3d8973d4fc8e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:21.228583 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e84ddde0-864d-4599-9984-3d8973d4fc8e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:21.229111 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e84ddde0-864d-4599-9984-3d8973d4fc8e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:21.236469 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e84ddde0-864d-4599-9984-3d8973d4fc8e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:21.240798 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e84ddde0-864d-4599-9984-3d8973d4fc8e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:21.290005 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3bcdb7ae-2dbe-4f7f-baf1-83d3133d3b37 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:21.303109 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3bcdb7ae-2dbe-4f7f-baf1-83d3133d3b37 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:21.323534 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3bcdb7ae-2dbe-4f7f-baf1-83d3133d3b37 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:21.325831 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3bcdb7ae-2dbe-4f7f-baf1-83d3133d3b37 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1740 microversion: 2.20 time: 0.313195 Jun 16 15:02:21.333884 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 359/719] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:21 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1740 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:21.907247 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e84ddde0-864d-4599-9984-3d8973d4fc8e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:21.925471 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e84ddde0-864d-4599-9984-3d8973d4fc8e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 200 len: 1365 microversion: 2.1 time: 0.740306 Jun 16 15:02:21.927917 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 361/720] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:21 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 1365 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:22.346991 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8277d2ea-0961-4717-be0d-b5824755ba41 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:22.348260 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8277d2ea-0961-4717-be0d-b5824755ba41 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:22.359001 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8277d2ea-0961-4717-be0d-b5824755ba41 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:22.363739 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8277d2ea-0961-4717-be0d-b5824755ba41 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:22.366924 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8277d2ea-0961-4717-be0d-b5824755ba41 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:22.376025 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8277d2ea-0961-4717-be0d-b5824755ba41 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:22.683015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8277d2ea-0961-4717-be0d-b5824755ba41 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:22.701863 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8277d2ea-0961-4717-be0d-b5824755ba41 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:22.708005 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8277d2ea-0961-4717-be0d-b5824755ba41 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:22.710130 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8277d2ea-0961-4717-be0d-b5824755ba41 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1740 microversion: 2.20 time: 0.367315 Jun 16 15:02:22.722988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 360/721] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:22 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1740 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:22.958439 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7638420a-1977-44dd-845a-a3b78f8d0d97 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:22.959415 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7638420a-1977-44dd-845a-a3b78f8d0d97 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:22.967114 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7638420a-1977-44dd-845a-a3b78f8d0d97 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:22.967573 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7638420a-1977-44dd-845a-a3b78f8d0d97 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:22.968446 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7638420a-1977-44dd-845a-a3b78f8d0d97 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:22.982132 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7638420a-1977-44dd-845a-a3b78f8d0d97 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:23.130848 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-af143319-d9e6-4993-bd55-ba495798e09b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1389256946"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:23.132078 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-af143319-d9e6-4993-bd55-ba495798e09b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:23.143927 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af143319-d9e6-4993-bd55-ba495798e09b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:23.150315 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af143319-d9e6-4993-bd55-ba495798e09b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:23.152612 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af143319-d9e6-4993-bd55-ba495798e09b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:23.156278 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af143319-d9e6-4993-bd55-ba495798e09b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:23.209609 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:23.395289 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7638420a-1977-44dd-845a-a3b78f8d0d97 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:23.409125 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7638420a-1977-44dd-845a-a3b78f8d0d97 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 200 len: 1365 microversion: 2.1 time: 0.455284 Jun 16 15:02:23.410884 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 362/722] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:22 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 1365 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:23.488252 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.network.security_group_api [None req-af143319-d9e6-4993-bd55-ba495798e09b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Adding security group 2fb7ef3c-5da8-4b98-a2fa-6921b88e8578 to port 186c05a0-cf63-4d64-870c-57ea93435c68 Jun 16 15:02:23.577862 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:23.598242 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=6 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:23.738290 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-00039286-071c-4548-a914-c1ad4bb19bd8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:23.739772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-00039286-071c-4548-a914-c1ad4bb19bd8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:23.753883 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-00039286-071c-4548-a914-c1ad4bb19bd8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:23.754711 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-00039286-071c-4548-a914-c1ad4bb19bd8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:23.756361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-00039286-071c-4548-a914-c1ad4bb19bd8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:23.757390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-00039286-071c-4548-a914-c1ad4bb19bd8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:23.758195 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=6 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:23.766288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:23.991201 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-00039286-071c-4548-a914-c1ad4bb19bd8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:24.034537 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-00039286-071c-4548-a914-c1ad4bb19bd8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:24.049335 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-00039286-071c-4548-a914-c1ad4bb19bd8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:24.050551 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-00039286-071c-4548-a914-c1ad4bb19bd8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1740 microversion: 2.20 time: 0.323619 Jun 16 15:02:24.054985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 363/723] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:23 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1740 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:24.165277 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-af143319-d9e6-4993-bd55-ba495798e09b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "POST /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8/action" status: 202 len: 0 microversion: 2.1 time: 1.038317 Jun 16 15:02:24.170281 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 361/724] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Jun 16 15:02:23 2022] POST /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8/action => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 15:02:24.173118 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-1fe5e092-50db-42c5-896f-53c3e49e3bf9 req-30ace8fb-0483-46f7-bcdb-97c0459b52a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55d202da-a7dd-4ab3-8d48-fda5c914f3c8", "tag": "186c05a0-cf63-4d64-870c-57ea93435c68"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:24.190150 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f9ebdc0d-d3d6-4dd9-a4d7-1232b5afc462 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:24.191541 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-1fe5e092-50db-42c5-896f-53c3e49e3bf9 req-30ace8fb-0483-46f7-bcdb-97c0459b52a0 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:24.192005 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-1fe5e092-50db-42c5-896f-53c3e49e3bf9 req-30ace8fb-0483-46f7-bcdb-97c0459b52a0 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:24.203322 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f9ebdc0d-d3d6-4dd9-a4d7-1232b5afc462 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:24.223347 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-1fe5e092-50db-42c5-896f-53c3e49e3bf9 req-30ace8fb-0483-46f7-bcdb-97c0459b52a0 service nova] Creating event network-changed:186c05a0-cf63-4d64-870c-57ea93435c68 for instance 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 on hv-cinder-83716 Jun 16 15:02:24.223724 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f9ebdc0d-d3d6-4dd9-a4d7-1232b5afc462 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:24.224398 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f9ebdc0d-d3d6-4dd9-a4d7-1232b5afc462 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:24.225706 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f9ebdc0d-d3d6-4dd9-a4d7-1232b5afc462 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:24.226371 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f9ebdc0d-d3d6-4dd9-a4d7-1232b5afc462 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:24.235779 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-1fe5e092-50db-42c5-896f-53c3e49e3bf9 req-30ace8fb-0483-46f7-bcdb-97c0459b52a0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069469 Jun 16 15:02:24.236598 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 364/725] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:02:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:02:24.439778 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7eea20f4-5266-411d-aaad-f6c29fdad4fc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:24.441793 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7eea20f4-5266-411d-aaad-f6c29fdad4fc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:24.453308 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7eea20f4-5266-411d-aaad-f6c29fdad4fc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:24.454166 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7eea20f4-5266-411d-aaad-f6c29fdad4fc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:24.456210 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7eea20f4-5266-411d-aaad-f6c29fdad4fc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:24.457196 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7eea20f4-5266-411d-aaad-f6c29fdad4fc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:24.686934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f9ebdc0d-d3d6-4dd9-a4d7-1232b5afc462 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:24.701459 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f9ebdc0d-d3d6-4dd9-a4d7-1232b5afc462 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1760 microversion: 2.1 time: 0.528754 Jun 16 15:02:24.702745 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 362/726] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:24 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1760 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:24.926146 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7eea20f4-5266-411d-aaad-f6c29fdad4fc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:24.933935 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7eea20f4-5266-411d-aaad-f6c29fdad4fc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 200 len: 1365 microversion: 2.1 time: 0.505760 Jun 16 15:02:24.934627 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 365/727] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:24 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 1365 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:02:25.080119 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-252281f5-498f-4d10-a940-3ddc5fff0dbf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:25.081076 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-252281f5-498f-4d10-a940-3ddc5fff0dbf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:25.090028 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-252281f5-498f-4d10-a940-3ddc5fff0dbf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:25.091139 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-252281f5-498f-4d10-a940-3ddc5fff0dbf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:25.092662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-252281f5-498f-4d10-a940-3ddc5fff0dbf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:25.093407 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-252281f5-498f-4d10-a940-3ddc5fff0dbf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:25.258004 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-252281f5-498f-4d10-a940-3ddc5fff0dbf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:25.268134 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-252281f5-498f-4d10-a940-3ddc5fff0dbf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:25.270773 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-252281f5-498f-4d10-a940-3ddc5fff0dbf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:25.272316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-252281f5-498f-4d10-a940-3ddc5fff0dbf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1740 microversion: 2.20 time: 0.196053 Jun 16 15:02:25.273106 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 363/728] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:25 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:25.955080 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-89df7553-93ad-4556-84f6-7349f3fad67f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:25.955890 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-89df7553-93ad-4556-84f6-7349f3fad67f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:25.978871 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-89df7553-93ad-4556-84f6-7349f3fad67f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:25.979472 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-89df7553-93ad-4556-84f6-7349f3fad67f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:25.980560 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-89df7553-93ad-4556-84f6-7349f3fad67f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:25.981267 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-89df7553-93ad-4556-84f6-7349f3fad67f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:26.184968 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-89df7553-93ad-4556-84f6-7349f3fad67f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:26.200714 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-89df7553-93ad-4556-84f6-7349f3fad67f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 200 len: 1365 microversion: 2.1 time: 0.249472 Jun 16 15:02:26.217373 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 366/729] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:25 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 1365 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:26.251443 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-18ab6816-8f40-4612-91b4-49aa3b973790 req-09bc38ee-b91f-4aae-91f7-c6983f79300a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6a310ce-a575-4379-9390-2b4ad718e3ed", "name": "network-vif-plugged", "status": "completed", "tag": "81f49aec-659a-46a4-b41a-827750fcd2ce"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:26.263250 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-18ab6816-8f40-4612-91b4-49aa3b973790 req-09bc38ee-b91f-4aae-91f7-c6983f79300a service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:26.263942 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-18ab6816-8f40-4612-91b4-49aa3b973790 req-09bc38ee-b91f-4aae-91f7-c6983f79300a service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:26.292391 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-939c6780-bded-4434-bebd-aa65c36bc3f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:26.293672 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-939c6780-bded-4434-bebd-aa65c36bc3f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:26.300061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-18ab6816-8f40-4612-91b4-49aa3b973790 req-09bc38ee-b91f-4aae-91f7-c6983f79300a service nova] Creating event network-vif-plugged:81f49aec-659a-46a4-b41a-827750fcd2ce for instance a6a310ce-a575-4379-9390-2b4ad718e3ed on hv-cinder-83716 Jun 16 15:02:26.305943 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-18ab6816-8f40-4612-91b4-49aa3b973790 req-09bc38ee-b91f-4aae-91f7-c6983f79300a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058201 Jun 16 15:02:26.307156 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 364/730] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:26.308116 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-939c6780-bded-4434-bebd-aa65c36bc3f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:26.308733 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-939c6780-bded-4434-bebd-aa65c36bc3f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:26.309678 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-939c6780-bded-4434-bebd-aa65c36bc3f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:26.310384 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-939c6780-bded-4434-bebd-aa65c36bc3f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:26.510969 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-939c6780-bded-4434-bebd-aa65c36bc3f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:26.521022 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-939c6780-bded-4434-bebd-aa65c36bc3f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:26.524727 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-939c6780-bded-4434-bebd-aa65c36bc3f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:26.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-939c6780-bded-4434-bebd-aa65c36bc3f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1740 microversion: 2.20 time: 0.238725 Jun 16 15:02:26.527291 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 367/731] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:26 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1740 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:27.292533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-69008e8f-66b8-4ce8-b2bd-eaa0b7203bde tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:27.293297 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-69008e8f-66b8-4ce8-b2bd-eaa0b7203bde tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:27.302209 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-69008e8f-66b8-4ce8-b2bd-eaa0b7203bde tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:27.302650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-69008e8f-66b8-4ce8-b2bd-eaa0b7203bde tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:27.304039 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-69008e8f-66b8-4ce8-b2bd-eaa0b7203bde tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:27.304488 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-69008e8f-66b8-4ce8-b2bd-eaa0b7203bde tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:27.454464 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-69008e8f-66b8-4ce8-b2bd-eaa0b7203bde tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:27.462517 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-69008e8f-66b8-4ce8-b2bd-eaa0b7203bde tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 200 len: 1365 microversion: 2.1 time: 0.247445 Jun 16 15:02:27.463102 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 365/732] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:27 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:27.544448 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b5cd98ce-0296-4b11-8c7a-36472173ac01 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:27.545126 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b5cd98ce-0296-4b11-8c7a-36472173ac01 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:27.552016 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b5cd98ce-0296-4b11-8c7a-36472173ac01 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:27.552473 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b5cd98ce-0296-4b11-8c7a-36472173ac01 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:27.553387 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b5cd98ce-0296-4b11-8c7a-36472173ac01 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:27.553830 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b5cd98ce-0296-4b11-8c7a-36472173ac01 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:27.708598 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b5cd98ce-0296-4b11-8c7a-36472173ac01 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:27.717581 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b5cd98ce-0296-4b11-8c7a-36472173ac01 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:27.719074 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b5cd98ce-0296-4b11-8c7a-36472173ac01 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:27.720241 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b5cd98ce-0296-4b11-8c7a-36472173ac01 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1740 microversion: 2.20 time: 0.179797 Jun 16 15:02:27.720798 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 368/733] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:27 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:28.479824 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-260448d3-c392-45e2-81c8-0ac932cec3d8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:28.480438 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-260448d3-c392-45e2-81c8-0ac932cec3d8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:28.486622 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-260448d3-c392-45e2-81c8-0ac932cec3d8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:28.487074 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-260448d3-c392-45e2-81c8-0ac932cec3d8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:28.487838 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-260448d3-c392-45e2-81c8-0ac932cec3d8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:28.488274 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-260448d3-c392-45e2-81c8-0ac932cec3d8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:28.620126 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-260448d3-c392-45e2-81c8-0ac932cec3d8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:28.627510 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-260448d3-c392-45e2-81c8-0ac932cec3d8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 200 len: 1365 microversion: 2.1 time: 0.151476 Jun 16 15:02:28.628060 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 366/734] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:28 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:28.739528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-83389d38-46ca-4f70-8904-622629bbac73 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:28.740149 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-83389d38-46ca-4f70-8904-622629bbac73 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:28.746830 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-83389d38-46ca-4f70-8904-622629bbac73 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:28.747292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-83389d38-46ca-4f70-8904-622629bbac73 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:28.748046 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-83389d38-46ca-4f70-8904-622629bbac73 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:28.748477 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-83389d38-46ca-4f70-8904-622629bbac73 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:28.881927 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-83389d38-46ca-4f70-8904-622629bbac73 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:28.890439 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-83389d38-46ca-4f70-8904-622629bbac73 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:28.891950 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-83389d38-46ca-4f70-8904-622629bbac73 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:28.893146 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-83389d38-46ca-4f70-8904-622629bbac73 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1740 microversion: 2.20 time: 0.157934 Jun 16 15:02:28.893700 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 369/735] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:28 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:29.645090 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b29778a2-3379-434f-ba54-e0871d654a1b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:29.645706 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b29778a2-3379-434f-ba54-e0871d654a1b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:29.652430 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b29778a2-3379-434f-ba54-e0871d654a1b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:29.652896 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b29778a2-3379-434f-ba54-e0871d654a1b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:29.653671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b29778a2-3379-434f-ba54-e0871d654a1b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:29.654095 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b29778a2-3379-434f-ba54-e0871d654a1b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:29.809898 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b29778a2-3379-434f-ba54-e0871d654a1b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:29.819633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b29778a2-3379-434f-ba54-e0871d654a1b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 200 len: 1365 microversion: 2.1 time: 0.178270 Jun 16 15:02:29.820212 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 367/736] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:29 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:29.912385 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-62bfc0d3-1a94-4734-8f9e-635f927e3dff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:29.913014 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-62bfc0d3-1a94-4734-8f9e-635f927e3dff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:29.919699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-62bfc0d3-1a94-4734-8f9e-635f927e3dff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:29.920140 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-62bfc0d3-1a94-4734-8f9e-635f927e3dff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:29.920948 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-62bfc0d3-1a94-4734-8f9e-635f927e3dff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:29.921388 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-62bfc0d3-1a94-4734-8f9e-635f927e3dff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:30.059615 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-62bfc0d3-1a94-4734-8f9e-635f927e3dff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:30.068047 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-62bfc0d3-1a94-4734-8f9e-635f927e3dff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:30.070112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-62bfc0d3-1a94-4734-8f9e-635f927e3dff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:30.071325 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-62bfc0d3-1a94-4734-8f9e-635f927e3dff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1722 microversion: 2.20 time: 0.162951 Jun 16 15:02:30.071877 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 370/737] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:29 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:30.838060 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-25596ffd-e2b5-4af4-93a3-a5a075fa3002 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:30.838687 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-25596ffd-e2b5-4af4-93a3-a5a075fa3002 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:30.840710 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:30.846301 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-25596ffd-e2b5-4af4-93a3-a5a075fa3002 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:30.846754 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-25596ffd-e2b5-4af4-93a3-a5a075fa3002 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:30.847508 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-25596ffd-e2b5-4af4-93a3-a5a075fa3002 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:30.847933 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-25596ffd-e2b5-4af4-93a3-a5a075fa3002 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:30.984335 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-25596ffd-e2b5-4af4-93a3-a5a075fa3002 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:30.991917 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-25596ffd-e2b5-4af4-93a3-a5a075fa3002 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 200 len: 1555 microversion: 2.1 time: 0.158372 Jun 16 15:02:30.992512 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 368/738] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:30 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:31.008819 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0078c9c7-5d90-48be-b982-dce26ec9fd94 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:31.009389 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0078c9c7-5d90-48be-b982-dce26ec9fd94 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:31.016417 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0078c9c7-5d90-48be-b982-dce26ec9fd94 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:31.016903 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0078c9c7-5d90-48be-b982-dce26ec9fd94 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:31.017688 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0078c9c7-5d90-48be-b982-dce26ec9fd94 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:31.018131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0078c9c7-5d90-48be-b982-dce26ec9fd94 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:31.035735 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3ba24a18-0e4b-4c2b-931f-02fabf9954be tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:31.036222 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3ba24a18-0e4b-4c2b-931f-02fabf9954be tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:31.042901 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3ba24a18-0e4b-4c2b-931f-02fabf9954be tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:31.043354 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3ba24a18-0e4b-4c2b-931f-02fabf9954be tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:31.045616 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3ba24a18-0e4b-4c2b-931f-02fabf9954be tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:31.045616 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3ba24a18-0e4b-4c2b-931f-02fabf9954be tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:31.069809 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3ba24a18-0e4b-4c2b-931f-02fabf9954be tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3/ips" status: 200 len: 146 microversion: 2.1 time: 0.037850 Jun 16 15:02:31.070760 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 369/739] 10.222.0.72 () {58 vars in 1247 bytes} [Thu Jun 16 15:02:31 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:02:31.090760 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f30d03ab-b70e-4409-9b02-8c8c66e6bc62 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:31.091467 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f30d03ab-b70e-4409-9b02-8c8c66e6bc62 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:31.098114 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f30d03ab-b70e-4409-9b02-8c8c66e6bc62 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:31.098561 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f30d03ab-b70e-4409-9b02-8c8c66e6bc62 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:31.099387 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f30d03ab-b70e-4409-9b02-8c8c66e6bc62 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:31.100404 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f30d03ab-b70e-4409-9b02-8c8c66e6bc62 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:31.105206 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0078c9c7-5d90-48be-b982-dce26ec9fd94 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100257 Jun 16 15:02:31.105796 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 371/740] 10.222.0.72 () {58 vars in 1274 bytes} [Thu Jun 16 15:02:31 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:31.362088 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f30d03ab-b70e-4409-9b02-8c8c66e6bc62 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:31.380781 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f30d03ab-b70e-4409-9b02-8c8c66e6bc62 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:31.383509 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f30d03ab-b70e-4409-9b02-8c8c66e6bc62 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:31.384820 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f30d03ab-b70e-4409-9b02-8c8c66e6bc62 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1722 microversion: 2.20 time: 0.298294 Jun 16 15:02:31.385502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 370/741] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:31 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:31.495332 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-8f919693-09eb-4c30-bd80-05e807b6ea1e req-bd2eb56f-5dfa-45a1-b640-38052a9313f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9", "name": "network-vif-unplugged", "status": "completed", "tag": "4a15d94a-43cc-45b4-89d5-3b8cdc6c8c65"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:31.507660 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-8f919693-09eb-4c30-bd80-05e807b6ea1e req-bd2eb56f-5dfa-45a1-b640-38052a9313f5 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:31.508354 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-8f919693-09eb-4c30-bd80-05e807b6ea1e req-bd2eb56f-5dfa-45a1-b640-38052a9313f5 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:31.521226 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-8f919693-09eb-4c30-bd80-05e807b6ea1e req-bd2eb56f-5dfa-45a1-b640-38052a9313f5 service nova] Creating event network-vif-unplugged:4a15d94a-43cc-45b4-89d5-3b8cdc6c8c65 for instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 on hv-cinder-83716 Jun 16 15:02:31.527472 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-8f919693-09eb-4c30-bd80-05e807b6ea1e req-bd2eb56f-5dfa-45a1-b640-38052a9313f5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035717 Jun 16 15:02:31.528358 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 372/742] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:32.285564 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-be1e634e-a29d-47d7-ac2a-4213dd37a5b6 req-930515b2-14a2-4110-a41a-4d8ad6267e79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6a310ce-a575-4379-9390-2b4ad718e3ed", "tag": "81f49aec-659a-46a4-b41a-827750fcd2ce"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:32.302561 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-be1e634e-a29d-47d7-ac2a-4213dd37a5b6 req-930515b2-14a2-4110-a41a-4d8ad6267e79 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:32.302561 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-be1e634e-a29d-47d7-ac2a-4213dd37a5b6 req-930515b2-14a2-4110-a41a-4d8ad6267e79 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:32.310347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-be1e634e-a29d-47d7-ac2a-4213dd37a5b6 req-930515b2-14a2-4110-a41a-4d8ad6267e79 service nova] Creating event network-changed:81f49aec-659a-46a4-b41a-827750fcd2ce for instance a6a310ce-a575-4379-9390-2b4ad718e3ed on hv-cinder-83716 Jun 16 15:02:32.317385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-be1e634e-a29d-47d7-ac2a-4213dd37a5b6 req-930515b2-14a2-4110-a41a-4d8ad6267e79 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037092 Jun 16 15:02:32.318056 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 371/743] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:32.407610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c1400bef-8a90-4ff0-9bf4-cd5f634a98b2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:32.408428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c1400bef-8a90-4ff0-9bf4-cd5f634a98b2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:32.417473 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c1400bef-8a90-4ff0-9bf4-cd5f634a98b2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:32.418103 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c1400bef-8a90-4ff0-9bf4-cd5f634a98b2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:32.418922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c1400bef-8a90-4ff0-9bf4-cd5f634a98b2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:32.419386 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c1400bef-8a90-4ff0-9bf4-cd5f634a98b2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:32.566728 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c1400bef-8a90-4ff0-9bf4-cd5f634a98b2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:32.575120 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c1400bef-8a90-4ff0-9bf4-cd5f634a98b2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:32.576683 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c1400bef-8a90-4ff0-9bf4-cd5f634a98b2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:32.577882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c1400bef-8a90-4ff0-9bf4-cd5f634a98b2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1722 microversion: 2.20 time: 0.175214 Jun 16 15:02:32.578440 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 373/744] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:32 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:33.314802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6f3b5570-92f3-46d7-81f0-ab3269f739fb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a59ccd73-606d-4e9c-ba6e-505490a7f12e"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:33.314802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6f3b5570-92f3-46d7-81f0-ab3269f739fb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:33.322854 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f3b5570-92f3-46d7-81f0-ab3269f739fb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:33.323300 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f3b5570-92f3-46d7-81f0-ab3269f739fb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:33.324073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f3b5570-92f3-46d7-81f0-ab3269f739fb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:33.324501 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f3b5570-92f3-46d7-81f0-ab3269f739fb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:33.601272 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2af1d202-5484-4d21-91e0-31e61680260d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:33.602950 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2af1d202-5484-4d21-91e0-31e61680260d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:33.611007 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2af1d202-5484-4d21-91e0-31e61680260d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:33.611459 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2af1d202-5484-4d21-91e0-31e61680260d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:33.612376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2af1d202-5484-4d21-91e0-31e61680260d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:33.613333 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2af1d202-5484-4d21-91e0-31e61680260d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:33.818392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6f3b5570-92f3-46d7-81f0-ab3269f739fb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "POST /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.509090 Jun 16 15:02:33.819333 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 372/745] 10.222.0.72 () {60 vars in 1322 bytes} [Thu Jun 16 15:02:33 2022] POST /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3/os-volume_attachments => generated 194 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:02:33.845738 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2af1d202-5484-4d21-91e0-31e61680260d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:33.855913 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2af1d202-5484-4d21-91e0-31e61680260d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:33.857528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2af1d202-5484-4d21-91e0-31e61680260d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:33.858690 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2af1d202-5484-4d21-91e0-31e61680260d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1725 microversion: 2.20 time: 0.264756 Jun 16 15:02:33.865089 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 374/746] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:33 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1725 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:33.882359 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9014bfec-4dde-4191-9e1c-ad9e362114b9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1393047-965a-4650-a812-c236458ee943"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:33.883853 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9014bfec-4dde-4191-9e1c-ad9e362114b9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:33.891409 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9014bfec-4dde-4191-9e1c-ad9e362114b9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:33.891863 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9014bfec-4dde-4191-9e1c-ad9e362114b9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:33.892752 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9014bfec-4dde-4191-9e1c-ad9e362114b9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:33.893339 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9014bfec-4dde-4191-9e1c-ad9e362114b9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:34.204604 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9014bfec-4dde-4191-9e1c-ad9e362114b9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "POST /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.327601 Jun 16 15:02:34.205437 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 373/747] 10.222.0.72 () {62 vars in 1363 bytes} [Thu Jun 16 15:02:33 2022] POST /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/os-volume_attachments => generated 188 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 15:02:34.323847 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f6aecc3c-5c35-43b6-bcc1-7816f7e1b099 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:34.324417 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f6aecc3c-5c35-43b6-bcc1-7816f7e1b099 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:34.330768 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f6aecc3c-5c35-43b6-bcc1-7816f7e1b099 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:34.331227 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f6aecc3c-5c35-43b6-bcc1-7816f7e1b099 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:34.332008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f6aecc3c-5c35-43b6-bcc1-7816f7e1b099 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:34.332452 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f6aecc3c-5c35-43b6-bcc1-7816f7e1b099 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:34.477584 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f6aecc3c-5c35-43b6-bcc1-7816f7e1b099 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "POST /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/action" status: 202 len: 0 microversion: 2.20 time: 0.157716 Jun 16 15:02:34.478118 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 375/748] 10.222.0.72 () {62 vars in 1318 bytes} [Thu Jun 16 15:02:34 2022] POST /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:02:34.486752 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1e3afc2c-7cd7-4e54-93cb-05ffd5dc9310 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:34.487346 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1e3afc2c-7cd7-4e54-93cb-05ffd5dc9310 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:34.495022 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e3afc2c-7cd7-4e54-93cb-05ffd5dc9310 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:34.495540 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e3afc2c-7cd7-4e54-93cb-05ffd5dc9310 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:34.496237 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e3afc2c-7cd7-4e54-93cb-05ffd5dc9310 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:34.496671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e3afc2c-7cd7-4e54-93cb-05ffd5dc9310 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:34.660273 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1e3afc2c-7cd7-4e54-93cb-05ffd5dc9310 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:34.672380 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1e3afc2c-7cd7-4e54-93cb-05ffd5dc9310 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:34.674239 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1e3afc2c-7cd7-4e54-93cb-05ffd5dc9310 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:34.675841 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1e3afc2c-7cd7-4e54-93cb-05ffd5dc9310 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1751 microversion: 2.20 time: 0.193151 Jun 16 15:02:34.677059 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 374/749] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:34 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1751 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:35.700146 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-deddc2be-5819-4c3f-b655-5205fabe6684 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:35.700748 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-deddc2be-5819-4c3f-b655-5205fabe6684 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:35.714522 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-deddc2be-5819-4c3f-b655-5205fabe6684 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:35.715323 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-deddc2be-5819-4c3f-b655-5205fabe6684 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:35.716323 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-deddc2be-5819-4c3f-b655-5205fabe6684 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:35.716831 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-deddc2be-5819-4c3f-b655-5205fabe6684 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:35.859853 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-deddc2be-5819-4c3f-b655-5205fabe6684 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:35.873042 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-deddc2be-5819-4c3f-b655-5205fabe6684 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:35.874845 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-deddc2be-5819-4c3f-b655-5205fabe6684 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:35.876649 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-deddc2be-5819-4c3f-b655-5205fabe6684 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1753 microversion: 2.20 time: 0.180618 Jun 16 15:02:35.887061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 376/750] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:35 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1753 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:36.895565 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6ad0e509-e09d-4530-b93e-7602d013aea6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:36.896169 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6ad0e509-e09d-4530-b93e-7602d013aea6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:36.902821 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6ad0e509-e09d-4530-b93e-7602d013aea6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:36.903428 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6ad0e509-e09d-4530-b93e-7602d013aea6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:36.904212 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6ad0e509-e09d-4530-b93e-7602d013aea6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:36.904654 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6ad0e509-e09d-4530-b93e-7602d013aea6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:37.035182 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6ad0e509-e09d-4530-b93e-7602d013aea6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:37.051180 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:37.057133 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6ad0e509-e09d-4530-b93e-7602d013aea6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:37.058625 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6ad0e509-e09d-4530-b93e-7602d013aea6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:37.059790 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6ad0e509-e09d-4530-b93e-7602d013aea6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1753 microversion: 2.20 time: 0.168174 Jun 16 15:02:37.060347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 375/751] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:36 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:38.078421 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3e257fbc-f0a0-4857-aec8-04d7191ba487 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:38.079038 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3e257fbc-f0a0-4857-aec8-04d7191ba487 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:38.086486 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e257fbc-f0a0-4857-aec8-04d7191ba487 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:38.086939 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e257fbc-f0a0-4857-aec8-04d7191ba487 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:38.087731 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e257fbc-f0a0-4857-aec8-04d7191ba487 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:38.088173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e257fbc-f0a0-4857-aec8-04d7191ba487 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:38.258326 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3e257fbc-f0a0-4857-aec8-04d7191ba487 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:38.268300 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3e257fbc-f0a0-4857-aec8-04d7191ba487 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:38.270076 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3e257fbc-f0a0-4857-aec8-04d7191ba487 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:38.272746 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3e257fbc-f0a0-4857-aec8-04d7191ba487 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1753 microversion: 2.20 time: 0.197474 Jun 16 15:02:38.272746 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 377/752] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:38 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1753 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:39.292754 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8642b5f8-0dae-4e82-83f2-a5256d9b7eb4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:39.293394 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8642b5f8-0dae-4e82-83f2-a5256d9b7eb4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:39.301156 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8642b5f8-0dae-4e82-83f2-a5256d9b7eb4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:39.301607 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8642b5f8-0dae-4e82-83f2-a5256d9b7eb4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:39.302392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8642b5f8-0dae-4e82-83f2-a5256d9b7eb4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:39.302833 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8642b5f8-0dae-4e82-83f2-a5256d9b7eb4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:39.458370 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8642b5f8-0dae-4e82-83f2-a5256d9b7eb4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:39.468744 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8642b5f8-0dae-4e82-83f2-a5256d9b7eb4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:39.470278 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8642b5f8-0dae-4e82-83f2-a5256d9b7eb4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:39.471439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8642b5f8-0dae-4e82-83f2-a5256d9b7eb4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1753 microversion: 2.20 time: 0.182984 Jun 16 15:02:39.471997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 376/753] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:39 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1753 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:40.489534 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c9096609-0c5d-4559-bf22-2f437426d8aa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:40.490689 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c9096609-0c5d-4559-bf22-2f437426d8aa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:40.497792 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9096609-0c5d-4559-bf22-2f437426d8aa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:40.498247 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9096609-0c5d-4559-bf22-2f437426d8aa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:40.499114 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9096609-0c5d-4559-bf22-2f437426d8aa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:40.499595 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9096609-0c5d-4559-bf22-2f437426d8aa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:40.676333 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c9096609-0c5d-4559-bf22-2f437426d8aa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:40.685196 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c9096609-0c5d-4559-bf22-2f437426d8aa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:40.686736 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c9096609-0c5d-4559-bf22-2f437426d8aa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:40.687996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c9096609-0c5d-4559-bf22-2f437426d8aa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1753 microversion: 2.20 time: 0.202512 Jun 16 15:02:40.688564 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 378/754] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:40 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1753 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:41.367618 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c0049133-a790-418c-b1bd-1dd024943805 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:02:41.375840 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c0049133-a790-418c-b1bd-1dd024943805 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:41.376554 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c0049133-a790-418c-b1bd-1dd024943805 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:41.442545 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c0049133-a790-418c-b1bd-1dd024943805 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Going to try to stop instance {{(pid=124589) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 15:02:41.491232 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c0049133-a790-418c-b1bd-1dd024943805 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "POST /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3/action" status: 202 len: 0 microversion: 2.1 time: 0.128371 Jun 16 15:02:41.491855 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 377/755] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Jun 16 15:02:41 2022] POST /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:02:41.503547 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-535a6725-3f2d-4ab3-9709-bd7896ad9efd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:41.504881 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-535a6725-3f2d-4ab3-9709-bd7896ad9efd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:41.512641 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-535a6725-3f2d-4ab3-9709-bd7896ad9efd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:41.513128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-535a6725-3f2d-4ab3-9709-bd7896ad9efd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:41.514020 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-535a6725-3f2d-4ab3-9709-bd7896ad9efd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:41.514462 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-535a6725-3f2d-4ab3-9709-bd7896ad9efd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:41.676139 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-535a6725-3f2d-4ab3-9709-bd7896ad9efd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:41.684445 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-535a6725-3f2d-4ab3-9709-bd7896ad9efd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1722 microversion: 2.1 time: 0.186350 Jun 16 15:02:41.687972 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 379/756] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:41 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:41.707358 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-dbeda7f3-f559-4d28-a514-799853c55063 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:41.708077 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-dbeda7f3-f559-4d28-a514-799853c55063 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:41.715069 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dbeda7f3-f559-4d28-a514-799853c55063 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:41.715516 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dbeda7f3-f559-4d28-a514-799853c55063 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:41.716278 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dbeda7f3-f559-4d28-a514-799853c55063 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:41.716716 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dbeda7f3-f559-4d28-a514-799853c55063 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:41.865141 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-dbeda7f3-f559-4d28-a514-799853c55063 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:41.873847 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-dbeda7f3-f559-4d28-a514-799853c55063 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:41.875328 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-dbeda7f3-f559-4d28-a514-799853c55063 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:41.876480 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-dbeda7f3-f559-4d28-a514-799853c55063 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1753 microversion: 2.20 time: 0.173924 Jun 16 15:02:41.877061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 378/757] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:41 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:42.706074 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-613e56d7-40be-418e-bffc-06751235b65a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:42.706776 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-613e56d7-40be-418e-bffc-06751235b65a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:42.714041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-613e56d7-40be-418e-bffc-06751235b65a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:42.714471 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-613e56d7-40be-418e-bffc-06751235b65a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:42.715226 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-613e56d7-40be-418e-bffc-06751235b65a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:42.715658 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-613e56d7-40be-418e-bffc-06751235b65a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:42.737986 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:42.897438 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-883ee726-059a-4634-9198-eedc15eda977 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:42.898435 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-883ee726-059a-4634-9198-eedc15eda977 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:42.904727 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-883ee726-059a-4634-9198-eedc15eda977 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:42.905524 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-883ee726-059a-4634-9198-eedc15eda977 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:42.906297 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-883ee726-059a-4634-9198-eedc15eda977 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:42.906728 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-883ee726-059a-4634-9198-eedc15eda977 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:42.960548 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-613e56d7-40be-418e-bffc-06751235b65a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:42.976579 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-613e56d7-40be-418e-bffc-06751235b65a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1722 microversion: 2.1 time: 0.274322 Jun 16 15:02:42.977217 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 380/758] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:42 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:02:43.056420 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-883ee726-059a-4634-9198-eedc15eda977 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:43.067291 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-883ee726-059a-4634-9198-eedc15eda977 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:43.068857 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-883ee726-059a-4634-9198-eedc15eda977 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:43.070086 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-883ee726-059a-4634-9198-eedc15eda977 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.177272 Jun 16 15:02:43.070649 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 379/759] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:42 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:43.998896 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-583bac4a-6507-433f-a6e6-b1d0ebf635b8 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:44.000538 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-583bac4a-6507-433f-a6e6-b1d0ebf635b8 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:44.009219 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-583bac4a-6507-433f-a6e6-b1d0ebf635b8 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:44.010009 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-583bac4a-6507-433f-a6e6-b1d0ebf635b8 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:44.011144 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-583bac4a-6507-433f-a6e6-b1d0ebf635b8 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:44.011799 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-583bac4a-6507-433f-a6e6-b1d0ebf635b8 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:44.089488 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fbdb6257-16f9-4bcd-ae7e-12442a9a173a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:44.090976 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fbdb6257-16f9-4bcd-ae7e-12442a9a173a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:44.120892 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fbdb6257-16f9-4bcd-ae7e-12442a9a173a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:44.122268 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fbdb6257-16f9-4bcd-ae7e-12442a9a173a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:44.123937 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fbdb6257-16f9-4bcd-ae7e-12442a9a173a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:44.125086 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fbdb6257-16f9-4bcd-ae7e-12442a9a173a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:44.272715 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-583bac4a-6507-433f-a6e6-b1d0ebf635b8 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:44.296300 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-583bac4a-6507-433f-a6e6-b1d0ebf635b8 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1722 microversion: 2.1 time: 0.301546 Jun 16 15:02:44.299016 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 381/760] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:43 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:44.381491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fbdb6257-16f9-4bcd-ae7e-12442a9a173a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:44.393997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fbdb6257-16f9-4bcd-ae7e-12442a9a173a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:44.396662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fbdb6257-16f9-4bcd-ae7e-12442a9a173a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:44.398186 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fbdb6257-16f9-4bcd-ae7e-12442a9a173a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.313756 Jun 16 15:02:44.399280 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 380/761] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:44 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:45.319287 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2d81c9d5-5c54-42dd-acd6-927ee0aaeaff tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:45.320367 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2d81c9d5-5c54-42dd-acd6-927ee0aaeaff tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:45.332802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d81c9d5-5c54-42dd-acd6-927ee0aaeaff tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:45.333283 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d81c9d5-5c54-42dd-acd6-927ee0aaeaff tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:45.334233 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d81c9d5-5c54-42dd-acd6-927ee0aaeaff tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:45.334879 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d81c9d5-5c54-42dd-acd6-927ee0aaeaff tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:45.423165 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-268868db-2191-4a7f-b330-99f23cbbc4c2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:45.425620 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-268868db-2191-4a7f-b330-99f23cbbc4c2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:45.448550 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-268868db-2191-4a7f-b330-99f23cbbc4c2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:45.449344 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-268868db-2191-4a7f-b330-99f23cbbc4c2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:45.450335 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-268868db-2191-4a7f-b330-99f23cbbc4c2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:45.450957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-268868db-2191-4a7f-b330-99f23cbbc4c2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:45.610310 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2d81c9d5-5c54-42dd-acd6-927ee0aaeaff tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:45.621532 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2d81c9d5-5c54-42dd-acd6-927ee0aaeaff tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1722 microversion: 2.1 time: 0.308386 Jun 16 15:02:45.622344 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 382/762] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:45 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:45.685558 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-268868db-2191-4a7f-b330-99f23cbbc4c2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:45.711137 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-268868db-2191-4a7f-b330-99f23cbbc4c2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:45.712916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-268868db-2191-4a7f-b330-99f23cbbc4c2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:45.714075 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-268868db-2191-4a7f-b330-99f23cbbc4c2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.299588 Jun 16 15:02:45.714817 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 381/763] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:45 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:46.645667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-edbfe76d-30e7-4dd7-a5c7-3dd3158afae5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:46.648519 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-edbfe76d-30e7-4dd7-a5c7-3dd3158afae5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:46.662672 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-edbfe76d-30e7-4dd7-a5c7-3dd3158afae5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:46.663240 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-edbfe76d-30e7-4dd7-a5c7-3dd3158afae5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:46.664421 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-edbfe76d-30e7-4dd7-a5c7-3dd3158afae5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:46.665015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-edbfe76d-30e7-4dd7-a5c7-3dd3158afae5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:46.733777 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-89936217-75c6-4fd4-98d4-7be8d890dfa4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:46.734368 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-89936217-75c6-4fd4-98d4-7be8d890dfa4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:46.741264 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89936217-75c6-4fd4-98d4-7be8d890dfa4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:46.741929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89936217-75c6-4fd4-98d4-7be8d890dfa4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:46.742620 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89936217-75c6-4fd4-98d4-7be8d890dfa4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:46.743085 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89936217-75c6-4fd4-98d4-7be8d890dfa4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:46.854134 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-edbfe76d-30e7-4dd7-a5c7-3dd3158afae5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:46.865889 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-edbfe76d-30e7-4dd7-a5c7-3dd3158afae5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1722 microversion: 2.1 time: 0.228502 Jun 16 15:02:46.866875 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 383/764] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:46 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:46.935018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-89936217-75c6-4fd4-98d4-7be8d890dfa4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:46.945151 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-89936217-75c6-4fd4-98d4-7be8d890dfa4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:46.946650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-89936217-75c6-4fd4-98d4-7be8d890dfa4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:46.947823 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-89936217-75c6-4fd4-98d4-7be8d890dfa4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.218343 Jun 16 15:02:46.948432 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 382/765] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:46 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:47.893341 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e82c257e-1545-4b2a-9604-94be443eeab7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:47.894223 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e82c257e-1545-4b2a-9604-94be443eeab7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:47.900827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e82c257e-1545-4b2a-9604-94be443eeab7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:47.901329 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e82c257e-1545-4b2a-9604-94be443eeab7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:47.902126 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e82c257e-1545-4b2a-9604-94be443eeab7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:47.902570 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e82c257e-1545-4b2a-9604-94be443eeab7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:47.971257 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fad34e27-3751-47b4-9901-9250b319fc83 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:47.972113 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fad34e27-3751-47b4-9901-9250b319fc83 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:47.979936 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fad34e27-3751-47b4-9901-9250b319fc83 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:47.980497 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fad34e27-3751-47b4-9901-9250b319fc83 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:47.981289 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fad34e27-3751-47b4-9901-9250b319fc83 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:47.981728 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fad34e27-3751-47b4-9901-9250b319fc83 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:48.049737 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e82c257e-1545-4b2a-9604-94be443eeab7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:48.058494 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e82c257e-1545-4b2a-9604-94be443eeab7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1722 microversion: 2.1 time: 0.168932 Jun 16 15:02:48.059280 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 384/766] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:47 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:48.140314 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fad34e27-3751-47b4-9901-9250b319fc83 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:48.150217 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fad34e27-3751-47b4-9901-9250b319fc83 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:48.151715 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fad34e27-3751-47b4-9901-9250b319fc83 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:48.152985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fad34e27-3751-47b4-9901-9250b319fc83 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.186677 Jun 16 15:02:48.153479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 383/767] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:47 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:49.076320 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7de62390-0d48-41e3-961b-c232b204e3b3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:49.077114 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7de62390-0d48-41e3-961b-c232b204e3b3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:49.079513 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=58 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:49.085480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7de62390-0d48-41e3-961b-c232b204e3b3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:49.085942 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7de62390-0d48-41e3-961b-c232b204e3b3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:49.086736 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7de62390-0d48-41e3-961b-c232b204e3b3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:49.087184 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7de62390-0d48-41e3-961b-c232b204e3b3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:49.174445 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-cb4c5c49-9f95-4246-a161-3a39e8495664 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:49.175632 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-cb4c5c49-9f95-4246-a161-3a39e8495664 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:49.192682 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cb4c5c49-9f95-4246-a161-3a39e8495664 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:49.194382 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cb4c5c49-9f95-4246-a161-3a39e8495664 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:49.195864 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cb4c5c49-9f95-4246-a161-3a39e8495664 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:49.196767 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cb4c5c49-9f95-4246-a161-3a39e8495664 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:49.277717 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7de62390-0d48-41e3-961b-c232b204e3b3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:49.288459 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7de62390-0d48-41e3-961b-c232b204e3b3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1722 microversion: 2.1 time: 0.216124 Jun 16 15:02:49.289090 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 385/768] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:49 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:02:49.369708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-cb4c5c49-9f95-4246-a161-3a39e8495664 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:49.379005 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-cb4c5c49-9f95-4246-a161-3a39e8495664 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:49.380560 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-cb4c5c49-9f95-4246-a161-3a39e8495664 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:49.381757 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-cb4c5c49-9f95-4246-a161-3a39e8495664 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.212937 Jun 16 15:02:49.382322 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 384/769] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:49 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:50.306571 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d3fd096f-a542-4e89-89d9-1c4005f5a2bd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:50.307350 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d3fd096f-a542-4e89-89d9-1c4005f5a2bd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:50.314343 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d3fd096f-a542-4e89-89d9-1c4005f5a2bd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:50.314796 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d3fd096f-a542-4e89-89d9-1c4005f5a2bd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:50.315577 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d3fd096f-a542-4e89-89d9-1c4005f5a2bd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:50.316018 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d3fd096f-a542-4e89-89d9-1c4005f5a2bd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:50.403734 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-808c5cb3-27de-4805-82d3-42d6983a0ab3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:50.404613 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-808c5cb3-27de-4805-82d3-42d6983a0ab3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:50.412145 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-808c5cb3-27de-4805-82d3-42d6983a0ab3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:50.412626 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-808c5cb3-27de-4805-82d3-42d6983a0ab3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:50.413773 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-808c5cb3-27de-4805-82d3-42d6983a0ab3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:50.414222 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-808c5cb3-27de-4805-82d3-42d6983a0ab3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:50.465673 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d3fd096f-a542-4e89-89d9-1c4005f5a2bd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:50.474712 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d3fd096f-a542-4e89-89d9-1c4005f5a2bd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1722 microversion: 2.1 time: 0.172455 Jun 16 15:02:50.486616 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 386/770] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:50 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:02:50.596252 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-808c5cb3-27de-4805-82d3-42d6983a0ab3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:50.605439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-808c5cb3-27de-4805-82d3-42d6983a0ab3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:50.606934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-808c5cb3-27de-4805-82d3-42d6983a0ab3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:50.608101 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-808c5cb3-27de-4805-82d3-42d6983a0ab3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.211516 Jun 16 15:02:50.608645 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 385/771] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:50 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:51.493627 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-803a3d06-ccde-491c-bef5-6916fabb7dd9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:51.494227 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-803a3d06-ccde-491c-bef5-6916fabb7dd9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:51.501172 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-803a3d06-ccde-491c-bef5-6916fabb7dd9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:51.501659 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-803a3d06-ccde-491c-bef5-6916fabb7dd9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:51.502453 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-803a3d06-ccde-491c-bef5-6916fabb7dd9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:51.502882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-803a3d06-ccde-491c-bef5-6916fabb7dd9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:51.627592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-678c07d5-ab1e-44b1-a0c0-f7d453732106 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:51.628312 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-678c07d5-ab1e-44b1-a0c0-f7d453732106 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:51.635677 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-678c07d5-ab1e-44b1-a0c0-f7d453732106 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:51.636214 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-678c07d5-ab1e-44b1-a0c0-f7d453732106 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:51.637101 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-678c07d5-ab1e-44b1-a0c0-f7d453732106 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:51.637716 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-678c07d5-ab1e-44b1-a0c0-f7d453732106 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:51.693939 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-803a3d06-ccde-491c-bef5-6916fabb7dd9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:51.702620 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-803a3d06-ccde-491c-bef5-6916fabb7dd9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1722 microversion: 2.1 time: 0.213423 Jun 16 15:02:51.703195 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 387/772] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:51 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:51.801359 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-678c07d5-ab1e-44b1-a0c0-f7d453732106 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:51.813338 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-678c07d5-ab1e-44b1-a0c0-f7d453732106 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:51.814829 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-678c07d5-ab1e-44b1-a0c0-f7d453732106 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:51.816018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-678c07d5-ab1e-44b1-a0c0-f7d453732106 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.193450 Jun 16 15:02:51.816740 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 386/773] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:51 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:52.721859 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7bf24a81-5926-4fdd-ab3f-ec85e8ce6617 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:52.722686 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7bf24a81-5926-4fdd-ab3f-ec85e8ce6617 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:52.730702 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7bf24a81-5926-4fdd-ab3f-ec85e8ce6617 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:52.731241 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7bf24a81-5926-4fdd-ab3f-ec85e8ce6617 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:52.732083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7bf24a81-5926-4fdd-ab3f-ec85e8ce6617 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:52.732591 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7bf24a81-5926-4fdd-ab3f-ec85e8ce6617 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:52.838909 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-01f9d89d-204a-454e-91ca-201aadb9f8a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:52.840279 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-01f9d89d-204a-454e-91ca-201aadb9f8a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:52.852235 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-01f9d89d-204a-454e-91ca-201aadb9f8a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:52.853224 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-01f9d89d-204a-454e-91ca-201aadb9f8a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:52.854610 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-01f9d89d-204a-454e-91ca-201aadb9f8a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:52.855389 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-01f9d89d-204a-454e-91ca-201aadb9f8a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:52.893233 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7bf24a81-5926-4fdd-ab3f-ec85e8ce6617 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:52.906823 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7bf24a81-5926-4fdd-ab3f-ec85e8ce6617 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1722 microversion: 2.1 time: 0.187353 Jun 16 15:02:52.907246 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 388/774] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:52 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:53.019338 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-01f9d89d-204a-454e-91ca-201aadb9f8a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:53.028565 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-01f9d89d-204a-454e-91ca-201aadb9f8a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:53.030424 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-01f9d89d-204a-454e-91ca-201aadb9f8a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:53.031571 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-01f9d89d-204a-454e-91ca-201aadb9f8a6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.200644 Jun 16 15:02:53.032126 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 387/775] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:52 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:53.924243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8fc09b49-233f-4071-b022-fb63a5123aa4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:53.925202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8fc09b49-233f-4071-b022-fb63a5123aa4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:53.932900 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8fc09b49-233f-4071-b022-fb63a5123aa4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:53.933403 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8fc09b49-233f-4071-b022-fb63a5123aa4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:53.934424 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8fc09b49-233f-4071-b022-fb63a5123aa4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:53.934992 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8fc09b49-233f-4071-b022-fb63a5123aa4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:54.053259 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b77f6467-9a6a-4a41-94fb-b7888195fe03 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:54.054561 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b77f6467-9a6a-4a41-94fb-b7888195fe03 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:54.064332 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b77f6467-9a6a-4a41-94fb-b7888195fe03 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:54.065111 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b77f6467-9a6a-4a41-94fb-b7888195fe03 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:54.066572 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b77f6467-9a6a-4a41-94fb-b7888195fe03 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:54.067345 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b77f6467-9a6a-4a41-94fb-b7888195fe03 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:54.119329 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8fc09b49-233f-4071-b022-fb63a5123aa4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:54.130394 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8fc09b49-233f-4071-b022-fb63a5123aa4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1722 microversion: 2.1 time: 0.210259 Jun 16 15:02:54.130854 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 389/776] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:53 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:54.246672 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b77f6467-9a6a-4a41-94fb-b7888195fe03 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:54.258066 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b77f6467-9a6a-4a41-94fb-b7888195fe03 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:54.260159 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b77f6467-9a6a-4a41-94fb-b7888195fe03 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:54.261759 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b77f6467-9a6a-4a41-94fb-b7888195fe03 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.213666 Jun 16 15:02:54.262348 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 388/777] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:54 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:55.150888 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-770d2674-026c-42f7-9822-2a972f800690 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:55.151656 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-770d2674-026c-42f7-9822-2a972f800690 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:55.160478 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-770d2674-026c-42f7-9822-2a972f800690 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:55.161349 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-770d2674-026c-42f7-9822-2a972f800690 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:55.162440 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-770d2674-026c-42f7-9822-2a972f800690 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:55.163164 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-770d2674-026c-42f7-9822-2a972f800690 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:55.281155 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c4a66228-9c74-491d-b4a7-b88cec2d9479 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:55.281789 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c4a66228-9c74-491d-b4a7-b88cec2d9479 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:55.289139 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c4a66228-9c74-491d-b4a7-b88cec2d9479 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:55.289624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c4a66228-9c74-491d-b4a7-b88cec2d9479 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:55.290400 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c4a66228-9c74-491d-b4a7-b88cec2d9479 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:55.290833 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c4a66228-9c74-491d-b4a7-b88cec2d9479 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:55.316199 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-770d2674-026c-42f7-9822-2a972f800690 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:55.338469 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-770d2674-026c-42f7-9822-2a972f800690 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1722 microversion: 2.1 time: 0.192010 Jun 16 15:02:55.339958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 390/778] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:55 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:55.439569 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c4a66228-9c74-491d-b4a7-b88cec2d9479 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:55.448226 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c4a66228-9c74-491d-b4a7-b88cec2d9479 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:55.449735 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c4a66228-9c74-491d-b4a7-b88cec2d9479 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:55.450899 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c4a66228-9c74-491d-b4a7-b88cec2d9479 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.174390 Jun 16 15:02:55.451483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 389/779] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:55 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:56.355625 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9a70e95e-895a-40d5-972c-4eaeb67a2e8f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:56.356211 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9a70e95e-895a-40d5-972c-4eaeb67a2e8f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:56.362792 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9a70e95e-895a-40d5-972c-4eaeb67a2e8f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:56.363267 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9a70e95e-895a-40d5-972c-4eaeb67a2e8f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:56.364072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9a70e95e-895a-40d5-972c-4eaeb67a2e8f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:56.365086 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9a70e95e-895a-40d5-972c-4eaeb67a2e8f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:56.473386 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-60f2a06b-8ae5-4fd3-8575-dc7ae7dae69c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:56.474477 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-60f2a06b-8ae5-4fd3-8575-dc7ae7dae69c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:56.484982 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-60f2a06b-8ae5-4fd3-8575-dc7ae7dae69c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:56.486132 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-60f2a06b-8ae5-4fd3-8575-dc7ae7dae69c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:56.487713 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-60f2a06b-8ae5-4fd3-8575-dc7ae7dae69c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:56.488707 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-60f2a06b-8ae5-4fd3-8575-dc7ae7dae69c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:56.528672 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9a70e95e-895a-40d5-972c-4eaeb67a2e8f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:56.538432 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9a70e95e-895a-40d5-972c-4eaeb67a2e8f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1722 microversion: 2.1 time: 0.186564 Jun 16 15:02:56.539060 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 391/780] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:56 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:56.647843 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-60f2a06b-8ae5-4fd3-8575-dc7ae7dae69c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:56.656831 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-60f2a06b-8ae5-4fd3-8575-dc7ae7dae69c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:56.658352 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-60f2a06b-8ae5-4fd3-8575-dc7ae7dae69c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:56.659528 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-60f2a06b-8ae5-4fd3-8575-dc7ae7dae69c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.192233 Jun 16 15:02:56.660077 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 390/781] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:56 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:02:57.557844 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-24fa42a4-dd83-494f-8a4e-cfbee8862d80 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:57.558587 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-24fa42a4-dd83-494f-8a4e-cfbee8862d80 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:57.565267 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24fa42a4-dd83-494f-8a4e-cfbee8862d80 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:57.565718 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24fa42a4-dd83-494f-8a4e-cfbee8862d80 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:57.566487 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24fa42a4-dd83-494f-8a4e-cfbee8862d80 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:57.566927 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24fa42a4-dd83-494f-8a4e-cfbee8862d80 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:57.677496 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-af4e553e-8971-4f6c-b32b-826723446388 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:57.678099 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-af4e553e-8971-4f6c-b32b-826723446388 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:57.684597 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af4e553e-8971-4f6c-b32b-826723446388 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:57.685080 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af4e553e-8971-4f6c-b32b-826723446388 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:57.685842 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af4e553e-8971-4f6c-b32b-826723446388 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:57.686273 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af4e553e-8971-4f6c-b32b-826723446388 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:57.700725 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-24fa42a4-dd83-494f-8a4e-cfbee8862d80 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:57.705303 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:02:57.709478 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-24fa42a4-dd83-494f-8a4e-cfbee8862d80 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1722 microversion: 2.1 time: 0.155474 Jun 16 15:02:57.710046 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 392/782] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:57 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:57.824777 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-af4e553e-8971-4f6c-b32b-826723446388 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:57.834143 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-af4e553e-8971-4f6c-b32b-826723446388 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:57.835633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-af4e553e-8971-4f6c-b32b-826723446388 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:57.836799 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-af4e553e-8971-4f6c-b32b-826723446388 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.163144 Jun 16 15:02:57.837386 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 391/783] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:57 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:58.727676 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-cde46c2b-7865-4d0a-aace-baa6a18038c1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:58.728242 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-cde46c2b-7865-4d0a-aace-baa6a18038c1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:58.734942 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cde46c2b-7865-4d0a-aace-baa6a18038c1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:58.735394 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cde46c2b-7865-4d0a-aace-baa6a18038c1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:58.736172 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cde46c2b-7865-4d0a-aace-baa6a18038c1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:58.736611 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cde46c2b-7865-4d0a-aace-baa6a18038c1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:58.856430 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4e729559-f67d-4f2b-9e62-45b7510b3488 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:58.857163 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4e729559-f67d-4f2b-9e62-45b7510b3488 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:58.864108 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4e729559-f67d-4f2b-9e62-45b7510b3488 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:58.864580 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4e729559-f67d-4f2b-9e62-45b7510b3488 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:58.865397 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4e729559-f67d-4f2b-9e62-45b7510b3488 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:58.865828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4e729559-f67d-4f2b-9e62-45b7510b3488 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:58.873358 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-cde46c2b-7865-4d0a-aace-baa6a18038c1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:58.882431 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-cde46c2b-7865-4d0a-aace-baa6a18038c1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1722 microversion: 2.1 time: 0.159112 Jun 16 15:02:58.883016 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 393/784] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:58 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:02:59.007568 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4e729559-f67d-4f2b-9e62-45b7510b3488 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:59.016714 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4e729559-f67d-4f2b-9e62-45b7510b3488 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:59.018461 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4e729559-f67d-4f2b-9e62-45b7510b3488 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:02:59.019799 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4e729559-f67d-4f2b-9e62-45b7510b3488 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.167787 Jun 16 15:02:59.020424 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 392/785] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:02:58 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:02:59.899618 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d2908cbd-e4dc-4fec-8192-2383e5f67564 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:02:59.900231 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d2908cbd-e4dc-4fec-8192-2383e5f67564 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:02:59.907348 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2908cbd-e4dc-4fec-8192-2383e5f67564 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:59.907795 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2908cbd-e4dc-4fec-8192-2383e5f67564 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:02:59.908563 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2908cbd-e4dc-4fec-8192-2383e5f67564 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:02:59.909078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2908cbd-e4dc-4fec-8192-2383e5f67564 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:00.040506 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-730da3ca-928f-46c3-8454-ae995d9e9447 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:00.041138 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-730da3ca-928f-46c3-8454-ae995d9e9447 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:00.050372 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-730da3ca-928f-46c3-8454-ae995d9e9447 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:00.050886 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-730da3ca-928f-46c3-8454-ae995d9e9447 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:00.051816 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-730da3ca-928f-46c3-8454-ae995d9e9447 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:00.052864 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-730da3ca-928f-46c3-8454-ae995d9e9447 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:00.058710 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d2908cbd-e4dc-4fec-8192-2383e5f67564 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:00.066843 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d2908cbd-e4dc-4fec-8192-2383e5f67564 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1722 microversion: 2.1 time: 0.171119 Jun 16 15:03:00.067496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 394/786] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:02:59 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:00.198799 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-730da3ca-928f-46c3-8454-ae995d9e9447 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:00.209292 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-730da3ca-928f-46c3-8454-ae995d9e9447 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:00.211012 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-730da3ca-928f-46c3-8454-ae995d9e9447 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:00.212346 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-730da3ca-928f-46c3-8454-ae995d9e9447 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.177014 Jun 16 15:03:00.213114 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 393/787] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:00 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:03:01.084107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d57c54d4-53dd-45b3-b01c-c7f72452c599 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:01.085577 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d57c54d4-53dd-45b3-b01c-c7f72452c599 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:01.092684 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d57c54d4-53dd-45b3-b01c-c7f72452c599 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:01.093163 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d57c54d4-53dd-45b3-b01c-c7f72452c599 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:01.093942 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d57c54d4-53dd-45b3-b01c-c7f72452c599 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:01.094375 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d57c54d4-53dd-45b3-b01c-c7f72452c599 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:01.238220 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c2ba3de1-7d95-42e1-9a0b-3e1ecefa6586 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:01.238933 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c2ba3de1-7d95-42e1-9a0b-3e1ecefa6586 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:01.241050 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d57c54d4-53dd-45b3-b01c-c7f72452c599 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:01.241602 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=52 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:01.248659 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c2ba3de1-7d95-42e1-9a0b-3e1ecefa6586 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:01.249153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c2ba3de1-7d95-42e1-9a0b-3e1ecefa6586 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:01.249948 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c2ba3de1-7d95-42e1-9a0b-3e1ecefa6586 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:01.250495 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c2ba3de1-7d95-42e1-9a0b-3e1ecefa6586 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:01.256558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d57c54d4-53dd-45b3-b01c-c7f72452c599 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1699 microversion: 2.1 time: 0.173085 Jun 16 15:03:01.256558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 395/788] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:01 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1699 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:01.269976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a187bd0a-f136-4fe5-818d-35e677927785 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:03:01.276241 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a187bd0a-f136-4fe5-818d-35e677927785 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:01.276700 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a187bd0a-f136-4fe5-818d-35e677927785 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:01.340232 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a187bd0a-f136-4fe5-818d-35e677927785 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Going to try to start instance {{(pid=124590) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 15:03:01.358757 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:01.385479 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a187bd0a-f136-4fe5-818d-35e677927785 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "POST /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3/action" status: 202 len: 0 microversion: 2.1 time: 0.119142 Jun 16 15:03:01.386089 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 396/789] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Jun 16 15:03:01 2022] POST /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 15:03:01.398616 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-920d442d-927d-4883-94e5-7efddeaf66dc tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:01.399338 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-920d442d-927d-4883-94e5-7efddeaf66dc tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:01.401460 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c2ba3de1-7d95-42e1-9a0b-3e1ecefa6586 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:01.406392 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-920d442d-927d-4883-94e5-7efddeaf66dc tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:01.406851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-920d442d-927d-4883-94e5-7efddeaf66dc tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:01.407628 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-920d442d-927d-4883-94e5-7efddeaf66dc tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:01.408227 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-920d442d-927d-4883-94e5-7efddeaf66dc tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:01.412149 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c2ba3de1-7d95-42e1-9a0b-3e1ecefa6586 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:01.414177 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c2ba3de1-7d95-42e1-9a0b-3e1ecefa6586 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:01.415337 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c2ba3de1-7d95-42e1-9a0b-3e1ecefa6586 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.181422 Jun 16 15:03:01.415885 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 394/790] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:01 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:03:01.547684 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-920d442d-927d-4883-94e5-7efddeaf66dc tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:01.556285 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-920d442d-927d-4883-94e5-7efddeaf66dc tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1708 microversion: 2.1 time: 0.165542 Jun 16 15:03:01.556879 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 397/791] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:01 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1708 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:03:02.434198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9a73e518-1535-4a25-8b4c-fe1a99ef7a5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:02.434951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9a73e518-1535-4a25-8b4c-fe1a99ef7a5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:02.441634 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a73e518-1535-4a25-8b4c-fe1a99ef7a5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:02.442096 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a73e518-1535-4a25-8b4c-fe1a99ef7a5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:02.443502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a73e518-1535-4a25-8b4c-fe1a99ef7a5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:02.443936 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a73e518-1535-4a25-8b4c-fe1a99ef7a5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:02.575067 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-93dd84f4-9073-4c7e-85a5-01d3a40fb410 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:02.576547 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-93dd84f4-9073-4c7e-85a5-01d3a40fb410 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:02.583111 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93dd84f4-9073-4c7e-85a5-01d3a40fb410 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:02.583641 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93dd84f4-9073-4c7e-85a5-01d3a40fb410 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:02.587153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9a73e518-1535-4a25-8b4c-fe1a99ef7a5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:02.590428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93dd84f4-9073-4c7e-85a5-01d3a40fb410 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:02.591275 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93dd84f4-9073-4c7e-85a5-01d3a40fb410 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:02.597743 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9a73e518-1535-4a25-8b4c-fe1a99ef7a5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:02.599418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9a73e518-1535-4a25-8b4c-fe1a99ef7a5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:02.600598 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9a73e518-1535-4a25-8b4c-fe1a99ef7a5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.170388 Jun 16 15:03:02.601393 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 395/792] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:02 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:03:02.742114 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-93dd84f4-9073-4c7e-85a5-01d3a40fb410 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:02.750565 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-93dd84f4-9073-4c7e-85a5-01d3a40fb410 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1708 microversion: 2.1 time: 0.180008 Jun 16 15:03:02.751128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 398/793] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:02 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1708 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:03.619351 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6a402088-98ea-4b43-98a3-6b8fdc4effce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:03.619974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6a402088-98ea-4b43-98a3-6b8fdc4effce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:03.627758 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6a402088-98ea-4b43-98a3-6b8fdc4effce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:03.628205 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6a402088-98ea-4b43-98a3-6b8fdc4effce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:03.629007 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6a402088-98ea-4b43-98a3-6b8fdc4effce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:03.629442 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6a402088-98ea-4b43-98a3-6b8fdc4effce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:03.767722 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9308332f-4944-454d-a8fb-f3366f5d3e03 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:03.768343 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9308332f-4944-454d-a8fb-f3366f5d3e03 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:03.775913 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9308332f-4944-454d-a8fb-f3366f5d3e03 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:03.776370 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9308332f-4944-454d-a8fb-f3366f5d3e03 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:03.777175 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9308332f-4944-454d-a8fb-f3366f5d3e03 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:03.777619 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9308332f-4944-454d-a8fb-f3366f5d3e03 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:03.783532 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6a402088-98ea-4b43-98a3-6b8fdc4effce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:03.793955 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6a402088-98ea-4b43-98a3-6b8fdc4effce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:03.795642 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6a402088-98ea-4b43-98a3-6b8fdc4effce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:03.796989 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6a402088-98ea-4b43-98a3-6b8fdc4effce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.181665 Jun 16 15:03:03.797635 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 396/794] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:03 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:03:03.916221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9308332f-4944-454d-a8fb-f3366f5d3e03 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:03.928155 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9308332f-4944-454d-a8fb-f3366f5d3e03 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1708 microversion: 2.1 time: 0.163993 Jun 16 15:03:03.929064 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 399/795] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:03 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1708 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:03:04.821182 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-454c1254-7869-4bc4-b2fa-e16bc000c0f8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:04.821962 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-454c1254-7869-4bc4-b2fa-e16bc000c0f8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:04.828777 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-454c1254-7869-4bc4-b2fa-e16bc000c0f8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:04.829274 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-454c1254-7869-4bc4-b2fa-e16bc000c0f8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:04.830031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-454c1254-7869-4bc4-b2fa-e16bc000c0f8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:04.830464 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-454c1254-7869-4bc4-b2fa-e16bc000c0f8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:04.951498 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1567271a-4927-4090-8593-95fa7ace006d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:04.957244 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1567271a-4927-4090-8593-95fa7ace006d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:04.960265 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1567271a-4927-4090-8593-95fa7ace006d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:04.960761 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1567271a-4927-4090-8593-95fa7ace006d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:04.961626 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1567271a-4927-4090-8593-95fa7ace006d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:04.962065 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1567271a-4927-4090-8593-95fa7ace006d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:04.969178 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-454c1254-7869-4bc4-b2fa-e16bc000c0f8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:04.978075 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-454c1254-7869-4bc4-b2fa-e16bc000c0f8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:04.979571 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-454c1254-7869-4bc4-b2fa-e16bc000c0f8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:04.980757 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-454c1254-7869-4bc4-b2fa-e16bc000c0f8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.164285 Jun 16 15:03:04.981411 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 397/796] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:04 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:03:05.105511 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1567271a-4927-4090-8593-95fa7ace006d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:05.113699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1567271a-4927-4090-8593-95fa7ace006d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1712 microversion: 2.1 time: 0.168792 Jun 16 15:03:05.114262 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 400/797] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:03:04 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1712 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:03:05.999633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a8e22d0a-7107-4707-a4fe-c344b7b760b3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:06.000233 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a8e22d0a-7107-4707-a4fe-c344b7b760b3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:06.007780 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a8e22d0a-7107-4707-a4fe-c344b7b760b3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:06.008235 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a8e22d0a-7107-4707-a4fe-c344b7b760b3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:06.009037 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a8e22d0a-7107-4707-a4fe-c344b7b760b3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:06.009469 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a8e22d0a-7107-4707-a4fe-c344b7b760b3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:06.157682 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a8e22d0a-7107-4707-a4fe-c344b7b760b3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:06.167185 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a8e22d0a-7107-4707-a4fe-c344b7b760b3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:06.168749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a8e22d0a-7107-4707-a4fe-c344b7b760b3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:06.169958 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a8e22d0a-7107-4707-a4fe-c344b7b760b3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.174271 Jun 16 15:03:06.170522 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 398/798] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:05 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:03:07.188791 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9cd6f28b-050e-493c-b9cb-765b3d92be1c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:07.189429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9cd6f28b-050e-493c-b9cb-765b3d92be1c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:07.197075 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9cd6f28b-050e-493c-b9cb-765b3d92be1c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:07.197531 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9cd6f28b-050e-493c-b9cb-765b3d92be1c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:07.198318 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9cd6f28b-050e-493c-b9cb-765b3d92be1c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:07.198757 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9cd6f28b-050e-493c-b9cb-765b3d92be1c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:07.340507 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9cd6f28b-050e-493c-b9cb-765b3d92be1c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:07.349816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9cd6f28b-050e-493c-b9cb-765b3d92be1c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:07.351327 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9cd6f28b-050e-493c-b9cb-765b3d92be1c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:07.352538 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9cd6f28b-050e-493c-b9cb-765b3d92be1c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.167779 Jun 16 15:03:07.353132 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 401/799] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:07 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:03:08.370657 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ee550e02-c586-42a8-8383-e8671abd6030 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:08.371273 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ee550e02-c586-42a8-8383-e8671abd6030 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:08.377858 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ee550e02-c586-42a8-8383-e8671abd6030 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:08.378299 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ee550e02-c586-42a8-8383-e8671abd6030 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:08.379124 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ee550e02-c586-42a8-8383-e8671abd6030 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:08.379551 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ee550e02-c586-42a8-8383-e8671abd6030 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:08.518251 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ee550e02-c586-42a8-8383-e8671abd6030 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:08.527367 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ee550e02-c586-42a8-8383-e8671abd6030 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:08.528886 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ee550e02-c586-42a8-8383-e8671abd6030 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:08.530314 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ee550e02-c586-42a8-8383-e8671abd6030 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.163307 Jun 16 15:03:08.530867 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 399/800] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:08 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:03:09.548080 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b67fa4e7-659c-4082-a589-47fbc7ab7b78 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:09.548662 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b67fa4e7-659c-4082-a589-47fbc7ab7b78 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:09.555901 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b67fa4e7-659c-4082-a589-47fbc7ab7b78 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:09.556386 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b67fa4e7-659c-4082-a589-47fbc7ab7b78 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:09.557170 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b67fa4e7-659c-4082-a589-47fbc7ab7b78 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:09.557600 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b67fa4e7-659c-4082-a589-47fbc7ab7b78 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:09.692600 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b67fa4e7-659c-4082-a589-47fbc7ab7b78 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:09.705380 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b67fa4e7-659c-4082-a589-47fbc7ab7b78 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:09.706923 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b67fa4e7-659c-4082-a589-47fbc7ab7b78 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:09.709057 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b67fa4e7-659c-4082-a589-47fbc7ab7b78 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.164515 Jun 16 15:03:09.710045 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 402/801] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:09 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:03:10.727693 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-472c338b-6a50-46f7-8398-3d1d02e0a411 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:10.728285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-472c338b-6a50-46f7-8398-3d1d02e0a411 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:10.735749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-472c338b-6a50-46f7-8398-3d1d02e0a411 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:10.736198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-472c338b-6a50-46f7-8398-3d1d02e0a411 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:10.737128 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-472c338b-6a50-46f7-8398-3d1d02e0a411 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:10.737570 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-472c338b-6a50-46f7-8398-3d1d02e0a411 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:10.885536 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-472c338b-6a50-46f7-8398-3d1d02e0a411 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:10.900434 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-472c338b-6a50-46f7-8398-3d1d02e0a411 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:10.902100 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-472c338b-6a50-46f7-8398-3d1d02e0a411 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:10.903184 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-472c338b-6a50-46f7-8398-3d1d02e0a411 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.179384 Jun 16 15:03:10.903781 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 400/802] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:10 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:03:11.921709 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-68fd1812-18a2-4568-afcd-d6c9d5e1c0b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:11.922303 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-68fd1812-18a2-4568-afcd-d6c9d5e1c0b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:11.929611 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-68fd1812-18a2-4568-afcd-d6c9d5e1c0b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:11.930062 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-68fd1812-18a2-4568-afcd-d6c9d5e1c0b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:11.930835 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-68fd1812-18a2-4568-afcd-d6c9d5e1c0b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:11.931278 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-68fd1812-18a2-4568-afcd-d6c9d5e1c0b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:12.294732 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-68fd1812-18a2-4568-afcd-d6c9d5e1c0b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:12.303439 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-68fd1812-18a2-4568-afcd-d6c9d5e1c0b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:12.304959 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-68fd1812-18a2-4568-afcd-d6c9d5e1c0b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:12.306134 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-68fd1812-18a2-4568-afcd-d6c9d5e1c0b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.388329 Jun 16 15:03:12.306687 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 403/803] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:11 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:03:13.323938 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b7e3c3fd-a857-4d64-ad31-2fc6cc8fa205 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:13.324676 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b7e3c3fd-a857-4d64-ad31-2fc6cc8fa205 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:13.332094 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b7e3c3fd-a857-4d64-ad31-2fc6cc8fa205 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:13.332544 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b7e3c3fd-a857-4d64-ad31-2fc6cc8fa205 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:13.333393 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b7e3c3fd-a857-4d64-ad31-2fc6cc8fa205 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:13.333857 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b7e3c3fd-a857-4d64-ad31-2fc6cc8fa205 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:13.480621 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b7e3c3fd-a857-4d64-ad31-2fc6cc8fa205 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:13.490468 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b7e3c3fd-a857-4d64-ad31-2fc6cc8fa205 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:13.492993 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b7e3c3fd-a857-4d64-ad31-2fc6cc8fa205 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:13.494166 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b7e3c3fd-a857-4d64-ad31-2fc6cc8fa205 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.174323 Jun 16 15:03:13.494757 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 401/804] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:13 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:03:13.978752 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-160c3306-1dfa-4ed8-a822-d8c059c2c111 req-7c9159fd-ca62-46db-bd77-d4feda6b473e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9", "name": "network-vif-plugged", "status": "completed", "tag": "4a15d94a-43cc-45b4-89d5-3b8cdc6c8c65"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:03:13.987251 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-160c3306-1dfa-4ed8-a822-d8c059c2c111 req-7c9159fd-ca62-46db-bd77-d4feda6b473e service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:13.987691 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-160c3306-1dfa-4ed8-a822-d8c059c2c111 req-7c9159fd-ca62-46db-bd77-d4feda6b473e service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:13.999502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-160c3306-1dfa-4ed8-a822-d8c059c2c111 req-7c9159fd-ca62-46db-bd77-d4feda6b473e service nova] Creating event network-vif-plugged:4a15d94a-43cc-45b4-89d5-3b8cdc6c8c65 for instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 on hv-cinder-83716 Jun 16 15:03:14.005450 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-160c3306-1dfa-4ed8-a822-d8c059c2c111 req-7c9159fd-ca62-46db-bd77-d4feda6b473e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123921 Jun 16 15:03:14.006054 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 404/805] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:03:14.513668 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ba67f2e7-8a0f-4b8d-81d6-e5d4ba72dc89 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:14.514800 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ba67f2e7-8a0f-4b8d-81d6-e5d4ba72dc89 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:14.523231 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ba67f2e7-8a0f-4b8d-81d6-e5d4ba72dc89 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:14.524185 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ba67f2e7-8a0f-4b8d-81d6-e5d4ba72dc89 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:14.525181 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ba67f2e7-8a0f-4b8d-81d6-e5d4ba72dc89 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:14.525796 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ba67f2e7-8a0f-4b8d-81d6-e5d4ba72dc89 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:14.668444 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ba67f2e7-8a0f-4b8d-81d6-e5d4ba72dc89 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:14.678309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ba67f2e7-8a0f-4b8d-81d6-e5d4ba72dc89 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:14.679889 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ba67f2e7-8a0f-4b8d-81d6-e5d4ba72dc89 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:14.681238 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ba67f2e7-8a0f-4b8d-81d6-e5d4ba72dc89 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.172794 Jun 16 15:03:14.681880 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 402/806] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:14 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:03:15.701322 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-02ac1ce5-53fb-4088-a48e-45969e6f7ac9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:15.702019 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-02ac1ce5-53fb-4088-a48e-45969e6f7ac9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:15.709084 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-02ac1ce5-53fb-4088-a48e-45969e6f7ac9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:15.709535 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-02ac1ce5-53fb-4088-a48e-45969e6f7ac9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:15.710371 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-02ac1ce5-53fb-4088-a48e-45969e6f7ac9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:15.710810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-02ac1ce5-53fb-4088-a48e-45969e6f7ac9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:15.861125 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-02ac1ce5-53fb-4088-a48e-45969e6f7ac9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:15.870696 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-02ac1ce5-53fb-4088-a48e-45969e6f7ac9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:15.872511 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-02ac1ce5-53fb-4088-a48e-45969e6f7ac9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:15.873968 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-02ac1ce5-53fb-4088-a48e-45969e6f7ac9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.176849 Jun 16 15:03:15.874640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 405/807] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:15 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:03:16.894403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fa2d5beb-a9ce-467c-af66-f23160547e91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:16.895510 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fa2d5beb-a9ce-467c-af66-f23160547e91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:16.902888 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa2d5beb-a9ce-467c-af66-f23160547e91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:16.903330 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa2d5beb-a9ce-467c-af66-f23160547e91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:16.904088 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa2d5beb-a9ce-467c-af66-f23160547e91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:16.904516 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa2d5beb-a9ce-467c-af66-f23160547e91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:17.047862 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fa2d5beb-a9ce-467c-af66-f23160547e91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:17.057644 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fa2d5beb-a9ce-467c-af66-f23160547e91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:17.059143 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fa2d5beb-a9ce-467c-af66-f23160547e91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:17.060356 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fa2d5beb-a9ce-467c-af66-f23160547e91 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1809 microversion: 2.20 time: 0.169830 Jun 16 15:03:17.060934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 403/808] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:16 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:03:18.090749 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e41346f4-2b38-4a5d-ae1e-38d6afc0f9c9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:03:18.091407 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e41346f4-2b38-4a5d-ae1e-38d6afc0f9c9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:18.097893 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e41346f4-2b38-4a5d-ae1e-38d6afc0f9c9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:18.098348 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e41346f4-2b38-4a5d-ae1e-38d6afc0f9c9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:18.099101 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e41346f4-2b38-4a5d-ae1e-38d6afc0f9c9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:18.099531 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e41346f4-2b38-4a5d-ae1e-38d6afc0f9c9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:18.231720 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e41346f4-2b38-4a5d-ae1e-38d6afc0f9c9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:18.240436 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e41346f4-2b38-4a5d-ae1e-38d6afc0f9c9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:18.242434 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e41346f4-2b38-4a5d-ae1e-38d6afc0f9c9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:03:18.243702 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e41346f4-2b38-4a5d-ae1e-38d6afc0f9c9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1796 microversion: 2.20 time: 0.157024 Jun 16 15:03:18.244258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 406/809] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:03:18 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1796 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:03:53.499927 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=19 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:53.500610 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=74 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:03:53.600731 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-793ca691-47fb-4d22-8279-15a7a5d93149 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9153a431-81fa-4f4d-b244-d22c2076bd5b"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:03:53.601892 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-793ca691-47fb-4d22-8279-15a7a5d93149 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:03:53.607945 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-793ca691-47fb-4d22-8279-15a7a5d93149 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:53.608399 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-793ca691-47fb-4d22-8279-15a7a5d93149 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:53.609192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-793ca691-47fb-4d22-8279-15a7a5d93149 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:03:53.609631 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-793ca691-47fb-4d22-8279-15a7a5d93149 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:03:53.872750 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-793ca691-47fb-4d22-8279-15a7a5d93149 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "POST /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.377463 Jun 16 15:03:53.873643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 404/810] 10.222.0.72 () {60 vars in 1322 bytes} [Thu Jun 16 15:03:53 2022] POST /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:01.371495 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8c6498f8-97ce-421b-b1cd-0eb80cb9c86c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:01.372450 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8c6498f8-97ce-421b-b1cd-0eb80cb9c86c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:01.374824 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=43 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:01.375505 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:01.382297 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c6498f8-97ce-421b-b1cd-0eb80cb9c86c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:01.382755 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c6498f8-97ce-421b-b1cd-0eb80cb9c86c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:01.383530 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c6498f8-97ce-421b-b1cd-0eb80cb9c86c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:01.383975 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c6498f8-97ce-421b-b1cd-0eb80cb9c86c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:01.407698 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-8c6498f8-97ce-421b-b1cd-0eb80cb9c86c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lazy-loading 'flavor' on Instance uuid 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:04:01.525634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8c6498f8-97ce-421b-b1cd-0eb80cb9c86c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "POST /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c/action" status: 200 len: 32 microversion: 2.1 time: 0.158571 Jun 16 15:04:01.526230 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 407/811] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Jun 16 15:04:01 2022] POST /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 15:04:01.536637 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a33295c9-3877-42f5-bb8e-c0aee98e6189 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:01.537410 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a33295c9-3877-42f5-bb8e-c0aee98e6189 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:01.543867 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a33295c9-3877-42f5-bb8e-c0aee98e6189 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:01.544454 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a33295c9-3877-42f5-bb8e-c0aee98e6189 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:01.545401 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a33295c9-3877-42f5-bb8e-c0aee98e6189 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:01.546218 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a33295c9-3877-42f5-bb8e-c0aee98e6189 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:01.681527 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a33295c9-3877-42f5-bb8e-c0aee98e6189 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:01.689806 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a33295c9-3877-42f5-bb8e-c0aee98e6189 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1736 microversion: 2.1 time: 0.157752 Jun 16 15:04:01.690327 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 405/812] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:01 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:02.708294 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-09670dbd-0000-4501-b7e9-42ad0d41fded tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:02.709017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-09670dbd-0000-4501-b7e9-42ad0d41fded tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:02.715274 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-09670dbd-0000-4501-b7e9-42ad0d41fded tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:02.715728 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-09670dbd-0000-4501-b7e9-42ad0d41fded tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:02.716492 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-09670dbd-0000-4501-b7e9-42ad0d41fded tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:02.716958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-09670dbd-0000-4501-b7e9-42ad0d41fded tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:02.851280 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-09670dbd-0000-4501-b7e9-42ad0d41fded tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:02.859244 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-09670dbd-0000-4501-b7e9-42ad0d41fded tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1736 microversion: 2.1 time: 0.155649 Jun 16 15:04:02.859802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 408/813] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:02 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:03.877550 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f82644f7-1a42-43f1-bbf4-9a338d4d4524 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:03.878120 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f82644f7-1a42-43f1-bbf4-9a338d4d4524 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:03.885124 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f82644f7-1a42-43f1-bbf4-9a338d4d4524 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:03.885585 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f82644f7-1a42-43f1-bbf4-9a338d4d4524 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:03.886382 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f82644f7-1a42-43f1-bbf4-9a338d4d4524 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:03.886818 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f82644f7-1a42-43f1-bbf4-9a338d4d4524 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:04.019271 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f82644f7-1a42-43f1-bbf4-9a338d4d4524 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:04.027174 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f82644f7-1a42-43f1-bbf4-9a338d4d4524 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1736 microversion: 2.1 time: 0.153572 Jun 16 15:04:04.027737 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 406/814] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:03 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:05.044518 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3f7d3ab2-f5d9-4fb0-94ad-79e41fefcd86 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:05.045153 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3f7d3ab2-f5d9-4fb0-94ad-79e41fefcd86 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:05.051607 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3f7d3ab2-f5d9-4fb0-94ad-79e41fefcd86 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:05.052055 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3f7d3ab2-f5d9-4fb0-94ad-79e41fefcd86 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:05.052806 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3f7d3ab2-f5d9-4fb0-94ad-79e41fefcd86 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:05.053268 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3f7d3ab2-f5d9-4fb0-94ad-79e41fefcd86 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:05.182568 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3f7d3ab2-f5d9-4fb0-94ad-79e41fefcd86 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:05.190874 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3f7d3ab2-f5d9-4fb0-94ad-79e41fefcd86 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1736 microversion: 2.1 time: 0.150090 Jun 16 15:04:05.191442 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 409/815] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:05 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:06.062254 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-95ae8279-7985-404e-b2de-9c938a7d4bfc tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:06.063263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-95ae8279-7985-404e-b2de-9c938a7d4bfc tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:06.070313 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-95ae8279-7985-404e-b2de-9c938a7d4bfc tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:06.070769 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-95ae8279-7985-404e-b2de-9c938a7d4bfc tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:06.071530 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-95ae8279-7985-404e-b2de-9c938a7d4bfc tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:06.071965 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-95ae8279-7985-404e-b2de-9c938a7d4bfc tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:06.144322 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-95ae8279-7985-404e-b2de-9c938a7d4bfc tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "POST /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8/action" status: 202 len: 0 microversion: 2.1 time: 0.085737 Jun 16 15:04:06.145094 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 407/816] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Jun 16 15:04:06 2022] POST /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:04:06.153100 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2c83535d-0869-4f6b-892c-5595ba6db66f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:06.153785 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2c83535d-0869-4f6b-892c-5595ba6db66f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:06.161012 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c83535d-0869-4f6b-892c-5595ba6db66f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:06.161528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c83535d-0869-4f6b-892c-5595ba6db66f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:06.162881 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c83535d-0869-4f6b-892c-5595ba6db66f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:06.163363 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c83535d-0869-4f6b-892c-5595ba6db66f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:06.209340 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9409cf60-6f8e-4016-84b5-df0cf82b2409 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:06.210179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9409cf60-6f8e-4016-84b5-df0cf82b2409 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:06.216879 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9409cf60-6f8e-4016-84b5-df0cf82b2409 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:06.217407 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9409cf60-6f8e-4016-84b5-df0cf82b2409 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:06.218234 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9409cf60-6f8e-4016-84b5-df0cf82b2409 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:06.218756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9409cf60-6f8e-4016-84b5-df0cf82b2409 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:06.355752 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9409cf60-6f8e-4016-84b5-df0cf82b2409 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:06.363771 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9409cf60-6f8e-4016-84b5-df0cf82b2409 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1736 microversion: 2.1 time: 0.159087 Jun 16 15:04:06.364341 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 408/817] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:06 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:06.370177 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2c83535d-0869-4f6b-892c-5595ba6db66f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:06.378802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2c83535d-0869-4f6b-892c-5595ba6db66f tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1752 microversion: 2.1 time: 0.229453 Jun 16 15:04:06.383137 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8ee6b057-7e87-4c00-a9a6-43d7366bf620 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:06.383633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8ee6b057-7e87-4c00-a9a6-43d7366bf620 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:06.386878 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 410/818] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:06 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1752 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:06.391024 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8ee6b057-7e87-4c00-a9a6-43d7366bf620 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:06.391472 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8ee6b057-7e87-4c00-a9a6-43d7366bf620 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:06.392233 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8ee6b057-7e87-4c00-a9a6-43d7366bf620 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:06.393060 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8ee6b057-7e87-4c00-a9a6-43d7366bf620 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:06.419842 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8ee6b057-7e87-4c00-a9a6-43d7366bf620 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:04:06.499606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8ee6b057-7e87-4c00-a9a6-43d7366bf620 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 204 len: 0 microversion: 2.1 time: 0.125553 Jun 16 15:04:06.500435 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 409/819] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:04:06 2022] DELETE /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:04:06.508869 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-cced0609-c4b7-4ee0-967e-3aa416b6b59c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:06.509471 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-cced0609-c4b7-4ee0-967e-3aa416b6b59c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:06.516449 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cced0609-c4b7-4ee0-967e-3aa416b6b59c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:06.516937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cced0609-c4b7-4ee0-967e-3aa416b6b59c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:06.517746 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cced0609-c4b7-4ee0-967e-3aa416b6b59c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:06.518177 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cced0609-c4b7-4ee0-967e-3aa416b6b59c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:06.652543 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-cced0609-c4b7-4ee0-967e-3aa416b6b59c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:06.660396 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-cced0609-c4b7-4ee0-967e-3aa416b6b59c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1577 microversion: 2.1 time: 0.155822 Jun 16 15:04:06.661023 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 411/820] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:06 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:07.325637 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:04:07.326246 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Thu Jun 16 15:04:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:04:07.382678 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9cf66436-5290-4d70-aff0-3125fb16a2fa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:07.383360 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9cf66436-5290-4d70-aff0-3125fb16a2fa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:07.389873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9cf66436-5290-4d70-aff0-3125fb16a2fa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:07.390317 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9cf66436-5290-4d70-aff0-3125fb16a2fa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:07.391065 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9cf66436-5290-4d70-aff0-3125fb16a2fa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:07.391493 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9cf66436-5290-4d70-aff0-3125fb16a2fa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:07.396940 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-589e7a45-761c-4fe6-bd12-efdd91824844 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:07.397577 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-589e7a45-761c-4fe6-bd12-efdd91824844 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:07.404136 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-589e7a45-761c-4fe6-bd12-efdd91824844 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:07.404590 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-589e7a45-761c-4fe6-bd12-efdd91824844 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:07.405694 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-589e7a45-761c-4fe6-bd12-efdd91824844 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:07.406132 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-589e7a45-761c-4fe6-bd12-efdd91824844 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:07.525972 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9cf66436-5290-4d70-aff0-3125fb16a2fa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:07.534382 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9cf66436-5290-4d70-aff0-3125fb16a2fa tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1736 microversion: 2.1 time: 0.156329 Jun 16 15:04:07.534939 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 410/821] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:07 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:07.554204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-589e7a45-761c-4fe6-bd12-efdd91824844 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:07.562375 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-589e7a45-761c-4fe6-bd12-efdd91824844 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1752 microversion: 2.1 time: 0.169372 Jun 16 15:04:07.562933 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 412/822] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:07 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:07.679302 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2ae200ce-4f12-4438-b058-d26069358de2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:07.679901 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2ae200ce-4f12-4438-b058-d26069358de2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:07.686470 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2ae200ce-4f12-4438-b058-d26069358de2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:07.686914 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2ae200ce-4f12-4438-b058-d26069358de2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:07.687671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2ae200ce-4f12-4438-b058-d26069358de2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:07.688101 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2ae200ce-4f12-4438-b058-d26069358de2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:07.821458 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2ae200ce-4f12-4438-b058-d26069358de2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:07.828936 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2ae200ce-4f12-4438-b058-d26069358de2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1577 microversion: 2.1 time: 0.154051 Jun 16 15:04:07.829486 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 411/823] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:07 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:08.551482 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-53cf95c5-b948-4483-8d8d-82b6b6f31821 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:08.552109 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-53cf95c5-b948-4483-8d8d-82b6b6f31821 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:08.559379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-53cf95c5-b948-4483-8d8d-82b6b6f31821 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:08.559837 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-53cf95c5-b948-4483-8d8d-82b6b6f31821 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:08.560606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-53cf95c5-b948-4483-8d8d-82b6b6f31821 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:08.561092 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-53cf95c5-b948-4483-8d8d-82b6b6f31821 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:08.579700 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8f2a592d-f9f6-40dd-9b52-54c6cc5285e9 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:08.580373 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8f2a592d-f9f6-40dd-9b52-54c6cc5285e9 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:08.586800 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8f2a592d-f9f6-40dd-9b52-54c6cc5285e9 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:08.587245 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8f2a592d-f9f6-40dd-9b52-54c6cc5285e9 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:08.587995 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8f2a592d-f9f6-40dd-9b52-54c6cc5285e9 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:08.588422 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8f2a592d-f9f6-40dd-9b52-54c6cc5285e9 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:08.699077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-53cf95c5-b948-4483-8d8d-82b6b6f31821 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:08.707070 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-53cf95c5-b948-4483-8d8d-82b6b6f31821 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1736 microversion: 2.1 time: 0.159381 Jun 16 15:04:08.707646 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 413/824] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:08 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:08.734912 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8f2a592d-f9f6-40dd-9b52-54c6cc5285e9 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:08.742885 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8f2a592d-f9f6-40dd-9b52-54c6cc5285e9 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1752 microversion: 2.1 time: 0.167004 Jun 16 15:04:08.743438 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 412/825] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:08 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:08.846058 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-63e0602f-2a9d-43d9-84b5-6f84fac12a20 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:08.846935 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-63e0602f-2a9d-43d9-84b5-6f84fac12a20 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:08.853766 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63e0602f-2a9d-43d9-84b5-6f84fac12a20 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:08.854226 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63e0602f-2a9d-43d9-84b5-6f84fac12a20 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:08.855007 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63e0602f-2a9d-43d9-84b5-6f84fac12a20 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:08.855450 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63e0602f-2a9d-43d9-84b5-6f84fac12a20 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:08.991810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-63e0602f-2a9d-43d9-84b5-6f84fac12a20 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:08.999349 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-63e0602f-2a9d-43d9-84b5-6f84fac12a20 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1577 microversion: 2.1 time: 0.157236 Jun 16 15:04:08.999902 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 414/826] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:08 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:09.724775 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6e5de8d2-1d81-4a8d-bca1-18e525681b1a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:09.726083 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6e5de8d2-1d81-4a8d-bca1-18e525681b1a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:09.732743 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e5de8d2-1d81-4a8d-bca1-18e525681b1a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:09.733228 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e5de8d2-1d81-4a8d-bca1-18e525681b1a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:09.733995 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e5de8d2-1d81-4a8d-bca1-18e525681b1a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:09.734433 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e5de8d2-1d81-4a8d-bca1-18e525681b1a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:09.762555 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-91d400c3-bad0-4443-b453-049130d0efec tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:09.763282 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-91d400c3-bad0-4443-b453-049130d0efec tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:09.771766 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-91d400c3-bad0-4443-b453-049130d0efec tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:09.772752 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-91d400c3-bad0-4443-b453-049130d0efec tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:09.773546 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-91d400c3-bad0-4443-b453-049130d0efec tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:09.774752 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-91d400c3-bad0-4443-b453-049130d0efec tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:09.897150 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6e5de8d2-1d81-4a8d-bca1-18e525681b1a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:09.906454 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6e5de8d2-1d81-4a8d-bca1-18e525681b1a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1736 microversion: 2.1 time: 0.185538 Jun 16 15:04:09.907052 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 413/827] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:09 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:09.963458 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-91d400c3-bad0-4443-b453-049130d0efec tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:09.971039 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-599ffe6c-846a-417c-a420-72dd60586e0f req-2028508a-1b92-4a9b-95b1-bc2f09fe57ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9376dd84-3783-460a-b0af-43ae018a961e", "name": "network-vif-deleted", "tag": "01ec3b9b-b35a-4c46-8071-a79f0aa795db"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:09.972143 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-91d400c3-bad0-4443-b453-049130d0efec tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1757 microversion: 2.1 time: 0.215222 Jun 16 15:04:09.972938 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 415/828] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:09 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1757 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:09.980654 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-599ffe6c-846a-417c-a420-72dd60586e0f req-2028508a-1b92-4a9b-95b1-bc2f09fe57ed service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:09.981211 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-599ffe6c-846a-417c-a420-72dd60586e0f req-2028508a-1b92-4a9b-95b1-bc2f09fe57ed service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:09.992793 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-599ffe6c-846a-417c-a420-72dd60586e0f req-2028508a-1b92-4a9b-95b1-bc2f09fe57ed service nova] Creating event network-vif-deleted:01ec3b9b-b35a-4c46-8071-a79f0aa795db for instance 9376dd84-3783-460a-b0af-43ae018a961e on hv-cinder-83716 Jun 16 15:04:09.998378 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-599ffe6c-846a-417c-a420-72dd60586e0f req-2028508a-1b92-4a9b-95b1-bc2f09fe57ed service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089850 Jun 16 15:04:09.999643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 414/829] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:10.017483 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-217008d3-d3be-48d8-8a33-352f3cd3e184 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:10.018170 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-217008d3-d3be-48d8-8a33-352f3cd3e184 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:10.026365 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-217008d3-d3be-48d8-8a33-352f3cd3e184 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:10.026831 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-217008d3-d3be-48d8-8a33-352f3cd3e184 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:10.027797 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-217008d3-d3be-48d8-8a33-352f3cd3e184 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:10.028294 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-217008d3-d3be-48d8-8a33-352f3cd3e184 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:10.095626 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-217008d3-d3be-48d8-8a33-352f3cd3e184 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:10.105380 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-217008d3-d3be-48d8-8a33-352f3cd3e184 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 200 len: 1510 microversion: 2.1 time: 0.091687 Jun 16 15:04:10.106886 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 416/830] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:10 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 1510 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:10.926298 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ff16fd63-c7d7-41e4-84db-2452cef003d4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:10.926995 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ff16fd63-c7d7-41e4-84db-2452cef003d4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:10.934895 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff16fd63-c7d7-41e4-84db-2452cef003d4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:10.935343 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff16fd63-c7d7-41e4-84db-2452cef003d4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:10.936109 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff16fd63-c7d7-41e4-84db-2452cef003d4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:10.936737 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff16fd63-c7d7-41e4-84db-2452cef003d4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:10.989737 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7a1e57e6-86d8-424f-9131-bbbb89495ea3 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:10.990341 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7a1e57e6-86d8-424f-9131-bbbb89495ea3 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:10.997071 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7a1e57e6-86d8-424f-9131-bbbb89495ea3 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:10.997532 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7a1e57e6-86d8-424f-9131-bbbb89495ea3 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:10.998324 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7a1e57e6-86d8-424f-9131-bbbb89495ea3 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:10.998827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7a1e57e6-86d8-424f-9131-bbbb89495ea3 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:11.089963 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ff16fd63-c7d7-41e4-84db-2452cef003d4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:11.098564 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ff16fd63-c7d7-41e4-84db-2452cef003d4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1736 microversion: 2.1 time: 0.178114 Jun 16 15:04:11.109579 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 415/831] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:10 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1736 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:11.123644 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2774a6db-b795-4bc9-9443-abe41b838c31 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:11.124501 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2774a6db-b795-4bc9-9443-abe41b838c31 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:11.131410 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2774a6db-b795-4bc9-9443-abe41b838c31 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:11.131860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2774a6db-b795-4bc9-9443-abe41b838c31 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:11.132689 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2774a6db-b795-4bc9-9443-abe41b838c31 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:11.133371 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2774a6db-b795-4bc9-9443-abe41b838c31 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:11.150376 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-2774a6db-b795-4bc9-9443-abe41b838c31 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] HTTP exception thrown: Instance 9376dd84-3783-460a-b0af-43ae018a961e could not be found. Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2774a6db-b795-4bc9-9443-abe41b838c31 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Request method failure captured: Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e HTTP/1.1 Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0VkLo99pEkQDuVjNTisJO2-sG7oVfv7DO08x8fqkx6EcNLLXf80_Hwjc01BE91RTfWmiZQQw1LJU0dTSoF8QgEcvi8VVSaDG7nlQTX7LVqf7oo8X0Fav6HUZko0kB1UBk7hD1FmWT7RPFUB0gIxy-F0bslaVdPohd5b8kzo1NfX-js Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 05223500b4a142c7a77c2de010541b84 Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-TestVolumeBootPattern-2072272021 Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 15:04:11.152073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 15:04:11.153599 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_05223500b4a142c7a77c2de010541b84", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/05223500b4a142c7a77c2de010541b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/05223500b4a142c7a77c2de010541b84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/05223500b4a142c7a77c2de010541b84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:04:11.153599 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-TestVolumeBootPattern-2072272021 Jun 16 15:04:11.153599 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 05223500b4a142c7a77c2de010541b84 Jun 16 15:04:11.153599 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-TestVolumeBootPattern-2072272021 Jun 16 15:04:11.153599 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-TestVolumeBootPattern-2072272021-project Jun 16 15:04:11.153599 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 15:04:11.153599 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 15:04:11.153599 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: 9d977f609537476daa8fe8adbab9ff9c Jun 16 15:04:11.153599 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-TestVolumeBootPattern-2072272021-project Jun 16 15:04:11.153599 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 15:04:11.153599 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance 9376dd84-3783-460a-b0af-43ae018a961e could not be found. Jun 16 15:04:11.153599 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': '9376dd84-3783-460a-b0af-43ae018a961e'} Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9376dd84-3783-460a-b0af-43ae018a961e could not be found. Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:04:11.154418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:04:11.156018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:04:11.156018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:04:11.156018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:04:11.156018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:04:11.156018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:04:11.156018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:04:11.156018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:04:11.156018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9376dd84-3783-460a-b0af-43ae018a961e could not be found. Jun 16 15:04:11.156018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:11.156018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:04:11.156018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:11.156018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:11.156018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:04:11.156018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:04:11.156018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:04:11.156018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:04:11.156018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9376dd84-3783-460a-b0af-43ae018a961e could not be found. Jun 16 15:04:11.156018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:11.158223 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2774a6db-b795-4bc9-9443-abe41b838c31 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Returning 404 to user: Instance 9376dd84-3783-460a-b0af-43ae018a961e could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:04:11.158223 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2774a6db-b795-4bc9-9443-abe41b838c31 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 404 len: 111 microversion: 2.1 time: 0.033775 Jun 16 15:04:11.158223 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 416/832] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:11 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 15:04:11.178225 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7a1e57e6-86d8-424f-9131-bbbb89495ea3 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:11.191531 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7a1e57e6-86d8-424f-9131-bbbb89495ea3 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1757 microversion: 2.1 time: 0.205315 Jun 16 15:04:11.193619 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 417/833] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:10 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1757 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:11.264953 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-48c730ef-ef3f-4ee5-bbd3-ffd1d6fa70d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2022488130", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1659470293", "security_groups": [{"name": "tempest-secgroup-smoke-425536924"}], "block_device_mapping_v2": [{"uuid": "416ef13b-afa0-40fe-bbd4-824f48e86465", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "90f95ec0-4a81-440f-8fe5-a85002b7b63b"}]}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:11.381990 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.network.neutron [None req-48c730ef-ef3f-4ee5-bbd3-ffd1d6fa70d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] validate_networks() for [('90f95ec0-4a81-440f-8fe5-a85002b7b63b', None, None, None, None, None)] {{(pid=124589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:04:11.807938 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-48c730ef-ef3f-4ee5-bbd3-ffd1d6fa70d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Flavor limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:04:11.808362 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-48c730ef-ef3f-4ee5-bbd3-ffd1d6fa70d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Image limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:04:11.808854 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-48c730ef-ef3f-4ee5-bbd3-ffd1d6fa70d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Flavor pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:04:11.809265 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-48c730ef-ef3f-4ee5-bbd3-ffd1d6fa70d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Image pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:04:11.809845 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-48c730ef-ef3f-4ee5-bbd3-ffd1d6fa70d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:04:11.819254 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-48c730ef-ef3f-4ee5-bbd3-ffd1d6fa70d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:11.819696 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-48c730ef-ef3f-4ee5-bbd3-ffd1d6fa70d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:11.820735 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-48c730ef-ef3f-4ee5-bbd3-ffd1d6fa70d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:11.821160 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-48c730ef-ef3f-4ee5-bbd3-ffd1d6fa70d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:11.838197 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-48c730ef-ef3f-4ee5-bbd3-ffd1d6fa70d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Getting quotas for project 05223500b4a142c7a77c2de010541b84. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:04:11.842245 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-48c730ef-ef3f-4ee5-bbd3-ffd1d6fa70d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Getting quotas for user 9d977f609537476daa8fe8adbab9ff9c and project 05223500b4a142c7a77c2de010541b84. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:04:11.901664 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-48c730ef-ef3f-4ee5-bbd3-ffd1d6fa70d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Going to run 1 instances... {{(pid=124589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:04:11.903908 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-48c730ef-ef3f-4ee5-bbd3-ffd1d6fa70d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='416ef13b-afa0-40fe-bbd4-824f48e86465',volume_size=None,volume_type=None)] {{(pid=124589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:04:12.044806 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-48c730ef-ef3f-4ee5-bbd3-ffd1d6fa70d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.783618 Jun 16 15:04:12.046197 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 417/834] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 15:04:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 15:04:12.057169 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8ad6d2e3-78b2-4b52-b0d2-9abd032b7e2e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:12.057876 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8ad6d2e3-78b2-4b52-b0d2-9abd032b7e2e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:12.120136 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f1bd60d5-7928-4cc0-9bec-59848ddd6cfc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:12.120884 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f1bd60d5-7928-4cc0-9bec-59848ddd6cfc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:12.125279 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8ad6d2e3-78b2-4b52-b0d2-9abd032b7e2e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:12.129906 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f1bd60d5-7928-4cc0-9bec-59848ddd6cfc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:12.130745 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f1bd60d5-7928-4cc0-9bec-59848ddd6cfc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:12.131968 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f1bd60d5-7928-4cc0-9bec-59848ddd6cfc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:12.132609 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f1bd60d5-7928-4cc0-9bec-59848ddd6cfc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:12.134163 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8ad6d2e3-78b2-4b52-b0d2-9abd032b7e2e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1095 microversion: 2.1 time: 0.081801 Jun 16 15:04:12.135243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 418/835] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:12 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1095 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:12.152707 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:12.211368 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0ce962fc-c022-4ad4-b70b-205f87b10066 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:12.211990 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0ce962fc-c022-4ad4-b70b-205f87b10066 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:12.218514 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0ce962fc-c022-4ad4-b70b-205f87b10066 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:12.218967 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0ce962fc-c022-4ad4-b70b-205f87b10066 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:12.219741 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0ce962fc-c022-4ad4-b70b-205f87b10066 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:12.220386 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0ce962fc-c022-4ad4-b70b-205f87b10066 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:12.289381 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f1bd60d5-7928-4cc0-9bec-59848ddd6cfc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:12.298196 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f1bd60d5-7928-4cc0-9bec-59848ddd6cfc tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1736 microversion: 2.1 time: 0.184491 Jun 16 15:04:12.299332 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 418/836] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:12 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1736 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:12.387857 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0ce962fc-c022-4ad4-b70b-205f87b10066 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:12.395802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0ce962fc-c022-4ad4-b70b-205f87b10066 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1757 microversion: 2.1 time: 0.188539 Jun 16 15:04:12.396375 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 419/837] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:12 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:13.152355 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-51822be7-e721-4eb7-97b4-148dcb9b9ba2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:13.153200 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-51822be7-e721-4eb7-97b4-148dcb9b9ba2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:13.160615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-51822be7-e721-4eb7-97b4-148dcb9b9ba2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:13.161110 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-51822be7-e721-4eb7-97b4-148dcb9b9ba2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:13.161937 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-51822be7-e721-4eb7-97b4-148dcb9b9ba2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:13.162383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-51822be7-e721-4eb7-97b4-148dcb9b9ba2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:13.247464 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-51822be7-e721-4eb7-97b4-148dcb9b9ba2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:13.256033 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-51822be7-e721-4eb7-97b4-148dcb9b9ba2 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1201 microversion: 2.1 time: 0.108085 Jun 16 15:04:13.257148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 419/838] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:13 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1201 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:13.315491 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6c949b18-0bb5-4f28-b2d0-bfa51cd557f7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:13.316090 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6c949b18-0bb5-4f28-b2d0-bfa51cd557f7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:13.326943 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6c949b18-0bb5-4f28-b2d0-bfa51cd557f7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:13.328335 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6c949b18-0bb5-4f28-b2d0-bfa51cd557f7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:13.329693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6c949b18-0bb5-4f28-b2d0-bfa51cd557f7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:13.331068 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6c949b18-0bb5-4f28-b2d0-bfa51cd557f7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:13.416060 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1e7b0bf3-74b7-4a4e-8ad2-637530b65a0e tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:13.417062 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1e7b0bf3-74b7-4a4e-8ad2-637530b65a0e tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:13.424903 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e7b0bf3-74b7-4a4e-8ad2-637530b65a0e tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:13.425721 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e7b0bf3-74b7-4a4e-8ad2-637530b65a0e tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:13.426750 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e7b0bf3-74b7-4a4e-8ad2-637530b65a0e tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:13.427443 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e7b0bf3-74b7-4a4e-8ad2-637530b65a0e tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:13.584467 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1e7b0bf3-74b7-4a4e-8ad2-637530b65a0e tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:13.592694 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1e7b0bf3-74b7-4a4e-8ad2-637530b65a0e tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1757 microversion: 2.1 time: 0.182232 Jun 16 15:04:13.593667 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 420/839] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:13 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:13.884006 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6c949b18-0bb5-4f28-b2d0-bfa51cd557f7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:13.892434 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6c949b18-0bb5-4f28-b2d0-bfa51cd557f7 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1736 microversion: 2.1 time: 0.580672 Jun 16 15:04:13.902534 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 420/840] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:13 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1736 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:14.274050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e714e3a7-7bcc-4d56-9f87-321afa77fc85 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:14.274830 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e714e3a7-7bcc-4d56-9f87-321afa77fc85 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:14.281839 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e714e3a7-7bcc-4d56-9f87-321afa77fc85 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:14.282210 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e714e3a7-7bcc-4d56-9f87-321afa77fc85 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:14.282969 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e714e3a7-7bcc-4d56-9f87-321afa77fc85 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:14.283394 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e714e3a7-7bcc-4d56-9f87-321afa77fc85 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:14.438404 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e714e3a7-7bcc-4d56-9f87-321afa77fc85 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:14.448767 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e714e3a7-7bcc-4d56-9f87-321afa77fc85 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1278 microversion: 2.1 time: 0.179024 Jun 16 15:04:14.461250 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 421/841] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:14 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:14.610484 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f9340c52-626c-465e-ae3e-32196b456ccb tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:14.611093 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f9340c52-626c-465e-ae3e-32196b456ccb tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:14.622412 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f9340c52-626c-465e-ae3e-32196b456ccb tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:14.622870 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f9340c52-626c-465e-ae3e-32196b456ccb tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:14.623649 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f9340c52-626c-465e-ae3e-32196b456ccb tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:14.624087 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f9340c52-626c-465e-ae3e-32196b456ccb tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:14.886550 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f9340c52-626c-465e-ae3e-32196b456ccb tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:14.894509 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f9340c52-626c-465e-ae3e-32196b456ccb tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1757 microversion: 2.1 time: 0.287825 Jun 16 15:04:14.895113 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 421/842] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:14 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1757 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:14.909415 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-17ea4f45-5790-4687-8968-dd211d2d0f0b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:14.910646 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-17ea4f45-5790-4687-8968-dd211d2d0f0b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:14.916042 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-17ea4f45-5790-4687-8968-dd211d2d0f0b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:14.916502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-17ea4f45-5790-4687-8968-dd211d2d0f0b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:14.917320 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-17ea4f45-5790-4687-8968-dd211d2d0f0b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:14.917766 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-17ea4f45-5790-4687-8968-dd211d2d0f0b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:15.054988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-17ea4f45-5790-4687-8968-dd211d2d0f0b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:15.064490 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-17ea4f45-5790-4687-8968-dd211d2d0f0b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1736 microversion: 2.1 time: 0.159052 Jun 16 15:04:15.066668 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 422/843] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:14 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:15.265665 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-9e4972ad-840c-4c0c-9df7-34f1195a819d req-14a66e4d-0be6-477e-a6db-3c9f9d8d30fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b26a44-c528-4cc8-b427-f43d8f0bc9a9", "tag": "cc43f90e-a572-4f83-9de1-aec44e329893"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:15.299089 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-9e4972ad-840c-4c0c-9df7-34f1195a819d req-14a66e4d-0be6-477e-a6db-3c9f9d8d30fc service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:15.299547 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-9e4972ad-840c-4c0c-9df7-34f1195a819d req-14a66e4d-0be6-477e-a6db-3c9f9d8d30fc service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:15.317222 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-9e4972ad-840c-4c0c-9df7-34f1195a819d req-14a66e4d-0be6-477e-a6db-3c9f9d8d30fc service nova] Creating event network-changed:cc43f90e-a572-4f83-9de1-aec44e329893 for instance c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 on hv-cinder-83716 Jun 16 15:04:15.322581 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-9e4972ad-840c-4c0c-9df7-34f1195a819d req-14a66e4d-0be6-477e-a6db-3c9f9d8d30fc service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060752 Jun 16 15:04:15.323337 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 422/844] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:15.467381 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f6a962da-f81c-401c-af15-131d556a086e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:15.468019 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f6a962da-f81c-401c-af15-131d556a086e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:15.474489 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f6a962da-f81c-401c-af15-131d556a086e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:15.474932 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f6a962da-f81c-401c-af15-131d556a086e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:15.476289 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f6a962da-f81c-401c-af15-131d556a086e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:15.476700 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f6a962da-f81c-401c-af15-131d556a086e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:15.612292 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f6a962da-f81c-401c-af15-131d556a086e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:15.620100 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f6a962da-f81c-401c-af15-131d556a086e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1266 microversion: 2.1 time: 0.156430 Jun 16 15:04:15.620680 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 423/845] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:15 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:15.912476 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c324acda-5217-4987-bc3e-9b9833a3436c tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:15.913230 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c324acda-5217-4987-bc3e-9b9833a3436c tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:15.919956 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c324acda-5217-4987-bc3e-9b9833a3436c tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:15.920417 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c324acda-5217-4987-bc3e-9b9833a3436c tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:15.921212 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c324acda-5217-4987-bc3e-9b9833a3436c tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:15.921660 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c324acda-5217-4987-bc3e-9b9833a3436c tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:15.925760 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:16.070879 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c324acda-5217-4987-bc3e-9b9833a3436c tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:16.078923 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c324acda-5217-4987-bc3e-9b9833a3436c tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1757 microversion: 2.1 time: 0.170613 Jun 16 15:04:16.079484 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 423/846] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:15 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:16.082781 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-58e1f9c1-fe47-44e6-9d95-b2e660cbd51f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:16.083391 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-58e1f9c1-fe47-44e6-9d95-b2e660cbd51f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:16.090014 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-58e1f9c1-fe47-44e6-9d95-b2e660cbd51f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:16.090462 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-58e1f9c1-fe47-44e6-9d95-b2e660cbd51f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:16.091225 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-58e1f9c1-fe47-44e6-9d95-b2e660cbd51f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:16.091651 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-58e1f9c1-fe47-44e6-9d95-b2e660cbd51f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:16.220341 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-58e1f9c1-fe47-44e6-9d95-b2e660cbd51f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:16.228209 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-58e1f9c1-fe47-44e6-9d95-b2e660cbd51f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1736 microversion: 2.1 time: 0.149491 Jun 16 15:04:16.228761 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 424/847] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:16 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:16.637500 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8a53770f-6a71-43f3-b32c-17cda5016d6b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:16.638106 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8a53770f-6a71-43f3-b32c-17cda5016d6b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:16.644154 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a53770f-6a71-43f3-b32c-17cda5016d6b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:16.644596 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a53770f-6a71-43f3-b32c-17cda5016d6b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:16.645531 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a53770f-6a71-43f3-b32c-17cda5016d6b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:16.645974 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a53770f-6a71-43f3-b32c-17cda5016d6b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:16.782593 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8a53770f-6a71-43f3-b32c-17cda5016d6b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:16.790357 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8a53770f-6a71-43f3-b32c-17cda5016d6b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1266 microversion: 2.1 time: 0.156602 Jun 16 15:04:16.790950 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 424/848] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:16 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:17.096905 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d478a112-cfdb-4ffd-a46a-1b4794e2eb91 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:17.097523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d478a112-cfdb-4ffd-a46a-1b4794e2eb91 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:17.104456 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d478a112-cfdb-4ffd-a46a-1b4794e2eb91 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:17.104946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d478a112-cfdb-4ffd-a46a-1b4794e2eb91 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:17.105707 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d478a112-cfdb-4ffd-a46a-1b4794e2eb91 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:17.106166 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d478a112-cfdb-4ffd-a46a-1b4794e2eb91 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:17.245107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4a551e92-c11b-480b-9f89-ea34336c3e78 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:17.245756 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4a551e92-c11b-480b-9f89-ea34336c3e78 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:17.252856 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4a551e92-c11b-480b-9f89-ea34336c3e78 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:17.253092 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d478a112-cfdb-4ffd-a46a-1b4794e2eb91 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:17.253317 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4a551e92-c11b-480b-9f89-ea34336c3e78 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:17.254099 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4a551e92-c11b-480b-9f89-ea34336c3e78 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:17.254536 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4a551e92-c11b-480b-9f89-ea34336c3e78 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:17.262614 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d478a112-cfdb-4ffd-a46a-1b4794e2eb91 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1757 microversion: 2.1 time: 0.169679 Jun 16 15:04:17.263280 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 425/849] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:17 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:17.457880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4a551e92-c11b-480b-9f89-ea34336c3e78 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:17.466486 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4a551e92-c11b-480b-9f89-ea34336c3e78 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1736 microversion: 2.1 time: 0.225672 Jun 16 15:04:17.467332 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 425/850] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:17 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1736 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:17.807470 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-235ef34b-811d-4e58-97d4-7187502a2f1c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:17.808083 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-235ef34b-811d-4e58-97d4-7187502a2f1c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:17.814368 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-235ef34b-811d-4e58-97d4-7187502a2f1c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:17.814808 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-235ef34b-811d-4e58-97d4-7187502a2f1c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:17.815562 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-235ef34b-811d-4e58-97d4-7187502a2f1c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:17.815991 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-235ef34b-811d-4e58-97d4-7187502a2f1c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:17.948175 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-235ef34b-811d-4e58-97d4-7187502a2f1c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:17.956728 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-235ef34b-811d-4e58-97d4-7187502a2f1c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1266 microversion: 2.1 time: 0.152343 Jun 16 15:04:17.956728 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 426/851] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:17 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:18.279612 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4b2a5acc-e70c-4bdc-bcb0-f064d5b0818b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:18.280143 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4b2a5acc-e70c-4bdc-bcb0-f064d5b0818b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:18.286951 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4b2a5acc-e70c-4bdc-bcb0-f064d5b0818b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:18.287405 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4b2a5acc-e70c-4bdc-bcb0-f064d5b0818b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:18.288688 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4b2a5acc-e70c-4bdc-bcb0-f064d5b0818b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:18.289149 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4b2a5acc-e70c-4bdc-bcb0-f064d5b0818b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:18.442788 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4b2a5acc-e70c-4bdc-bcb0-f064d5b0818b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:18.450953 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4b2a5acc-e70c-4bdc-bcb0-f064d5b0818b tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1757 microversion: 2.1 time: 0.175298 Jun 16 15:04:18.451532 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 426/852] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:18 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:18.483886 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3bfa65c5-8e1d-46da-a6d8-feafe5708963 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:18.484463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3bfa65c5-8e1d-46da-a6d8-feafe5708963 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:18.490946 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3bfa65c5-8e1d-46da-a6d8-feafe5708963 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:18.491385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3bfa65c5-8e1d-46da-a6d8-feafe5708963 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:18.492127 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3bfa65c5-8e1d-46da-a6d8-feafe5708963 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:18.492552 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3bfa65c5-8e1d-46da-a6d8-feafe5708963 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:18.624611 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3bfa65c5-8e1d-46da-a6d8-feafe5708963 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:18.632874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3bfa65c5-8e1d-46da-a6d8-feafe5708963 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1736 microversion: 2.1 time: 0.152789 Jun 16 15:04:18.633437 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 427/853] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:18 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:18.973518 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a176bd65-1a0f-455c-a0f1-31597bcd2da8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:18.974136 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a176bd65-1a0f-455c-a0f1-31597bcd2da8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:18.982972 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a176bd65-1a0f-455c-a0f1-31597bcd2da8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:18.983425 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a176bd65-1a0f-455c-a0f1-31597bcd2da8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:18.985710 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a176bd65-1a0f-455c-a0f1-31597bcd2da8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:18.986176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a176bd65-1a0f-455c-a0f1-31597bcd2da8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:19.117533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a176bd65-1a0f-455c-a0f1-31597bcd2da8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:19.125506 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a176bd65-1a0f-455c-a0f1-31597bcd2da8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1266 microversion: 2.1 time: 0.155773 Jun 16 15:04:19.126265 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 427/854] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:18 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:19.468956 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fef5e643-a7ff-431e-8e42-5635215edbb9 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:19.469618 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fef5e643-a7ff-431e-8e42-5635215edbb9 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:19.475658 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fef5e643-a7ff-431e-8e42-5635215edbb9 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:19.476119 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fef5e643-a7ff-431e-8e42-5635215edbb9 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:19.476897 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fef5e643-a7ff-431e-8e42-5635215edbb9 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:19.477339 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fef5e643-a7ff-431e-8e42-5635215edbb9 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:19.624480 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fef5e643-a7ff-431e-8e42-5635215edbb9 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:19.632602 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fef5e643-a7ff-431e-8e42-5635215edbb9 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1757 microversion: 2.1 time: 0.167652 Jun 16 15:04:19.633200 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 428/855] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:19 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:19.651288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-02887a18-9d00-41b6-ba31-28a5c226a45f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:19.651895 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-02887a18-9d00-41b6-ba31-28a5c226a45f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:19.659286 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-02887a18-9d00-41b6-ba31-28a5c226a45f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:19.659745 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-02887a18-9d00-41b6-ba31-28a5c226a45f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:19.660553 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-02887a18-9d00-41b6-ba31-28a5c226a45f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:19.661035 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-02887a18-9d00-41b6-ba31-28a5c226a45f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:19.795677 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-02887a18-9d00-41b6-ba31-28a5c226a45f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:19.804458 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-02887a18-9d00-41b6-ba31-28a5c226a45f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1736 microversion: 2.1 time: 0.157172 Jun 16 15:04:19.805049 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 428/856] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:19 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:20.142047 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b479f74b-8f8b-4a66-81a5-e10bb1599689 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:20.142658 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b479f74b-8f8b-4a66-81a5-e10bb1599689 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:20.149496 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b479f74b-8f8b-4a66-81a5-e10bb1599689 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:20.149940 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b479f74b-8f8b-4a66-81a5-e10bb1599689 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:20.150721 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b479f74b-8f8b-4a66-81a5-e10bb1599689 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:20.151148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b479f74b-8f8b-4a66-81a5-e10bb1599689 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:20.291716 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b479f74b-8f8b-4a66-81a5-e10bb1599689 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:20.299320 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b479f74b-8f8b-4a66-81a5-e10bb1599689 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1266 microversion: 2.1 time: 0.161133 Jun 16 15:04:20.299883 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 429/857] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:20 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:20.650542 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-091d673c-b312-415b-8a80-5262f0934556 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:20.651152 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-091d673c-b312-415b-8a80-5262f0934556 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:20.658496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-091d673c-b312-415b-8a80-5262f0934556 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:20.658496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-091d673c-b312-415b-8a80-5262f0934556 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:20.659225 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-091d673c-b312-415b-8a80-5262f0934556 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:20.659621 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-091d673c-b312-415b-8a80-5262f0934556 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:20.800318 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-091d673c-b312-415b-8a80-5262f0934556 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:20.809552 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-091d673c-b312-415b-8a80-5262f0934556 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1757 microversion: 2.1 time: 0.163555 Jun 16 15:04:20.810137 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 429/858] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:20 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:20.822141 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-386cd22f-949a-4a3b-ac16-a6ea5acb4411 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:20.822740 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-386cd22f-949a-4a3b-ac16-a6ea5acb4411 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:20.829278 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-386cd22f-949a-4a3b-ac16-a6ea5acb4411 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:20.829717 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-386cd22f-949a-4a3b-ac16-a6ea5acb4411 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:20.830469 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-386cd22f-949a-4a3b-ac16-a6ea5acb4411 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:20.830898 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-386cd22f-949a-4a3b-ac16-a6ea5acb4411 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:20.962302 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-386cd22f-949a-4a3b-ac16-a6ea5acb4411 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:20.970330 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-386cd22f-949a-4a3b-ac16-a6ea5acb4411 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1736 microversion: 2.1 time: 0.152629 Jun 16 15:04:20.970888 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 430/859] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:20 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:21.315747 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-feebfe08-b734-4310-abe8-518affcba8d1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:21.316358 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-feebfe08-b734-4310-abe8-518affcba8d1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:21.322967 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-feebfe08-b734-4310-abe8-518affcba8d1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:21.323430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-feebfe08-b734-4310-abe8-518affcba8d1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:21.324209 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-feebfe08-b734-4310-abe8-518affcba8d1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:21.324670 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-feebfe08-b734-4310-abe8-518affcba8d1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:21.460166 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-feebfe08-b734-4310-abe8-518affcba8d1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:21.467723 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-feebfe08-b734-4310-abe8-518affcba8d1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1266 microversion: 2.1 time: 0.155841 Jun 16 15:04:21.468284 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 430/860] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:21 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:21.827639 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-525f8838-477c-4e7f-a598-6f705f7b7c91 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:21.828242 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-525f8838-477c-4e7f-a598-6f705f7b7c91 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:21.830582 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:21.836525 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-525f8838-477c-4e7f-a598-6f705f7b7c91 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:21.837010 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-525f8838-477c-4e7f-a598-6f705f7b7c91 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:21.837773 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-525f8838-477c-4e7f-a598-6f705f7b7c91 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:21.838209 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-525f8838-477c-4e7f-a598-6f705f7b7c91 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:21.853177 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=6 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:21.988026 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9f659849-2b10-4f57-8c2e-4f6189c0aea6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:21.988670 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9f659849-2b10-4f57-8c2e-4f6189c0aea6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:21.995490 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9f659849-2b10-4f57-8c2e-4f6189c0aea6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:21.995944 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9f659849-2b10-4f57-8c2e-4f6189c0aea6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:21.996730 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9f659849-2b10-4f57-8c2e-4f6189c0aea6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:21.997203 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9f659849-2b10-4f57-8c2e-4f6189c0aea6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:22.132937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:22.136156 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9f659849-2b10-4f57-8c2e-4f6189c0aea6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:22.144684 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9f659849-2b10-4f57-8c2e-4f6189c0aea6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1736 microversion: 2.1 time: 0.160451 Jun 16 15:04:22.145391 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 431/861] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:21 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:22.206413 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-525f8838-477c-4e7f-a598-6f705f7b7c91 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:22.214815 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-525f8838-477c-4e7f-a598-6f705f7b7c91 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1760 microversion: 2.1 time: 0.391079 Jun 16 15:04:22.215372 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 431/862] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:21 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1760 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:22.485155 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-927f36bb-4651-461f-b4b1-838efa204b42 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:22.485772 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-927f36bb-4651-461f-b4b1-838efa204b42 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:22.492438 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-927f36bb-4651-461f-b4b1-838efa204b42 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:22.492920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-927f36bb-4651-461f-b4b1-838efa204b42 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:22.493686 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-927f36bb-4651-461f-b4b1-838efa204b42 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:22.494123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-927f36bb-4651-461f-b4b1-838efa204b42 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:22.641114 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-927f36bb-4651-461f-b4b1-838efa204b42 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:22.648595 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-927f36bb-4651-461f-b4b1-838efa204b42 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1266 microversion: 2.1 time: 0.167325 Jun 16 15:04:22.649197 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 432/863] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:22 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:23.162630 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b6594ec6-ec35-443f-9240-b93650a4f77c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:23.163195 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b6594ec6-ec35-443f-9240-b93650a4f77c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:23.170743 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b6594ec6-ec35-443f-9240-b93650a4f77c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:23.171194 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b6594ec6-ec35-443f-9240-b93650a4f77c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:23.171963 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b6594ec6-ec35-443f-9240-b93650a4f77c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:23.172405 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b6594ec6-ec35-443f-9240-b93650a4f77c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:23.307910 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b6594ec6-ec35-443f-9240-b93650a4f77c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:23.316309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b6594ec6-ec35-443f-9240-b93650a4f77c tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1716 microversion: 2.1 time: 0.157659 Jun 16 15:04:23.316888 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 432/864] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:23 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:23.370304 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1cb7a0b5-2a0c-4f34-b078-c0f8f7ee2ca9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:23.370824 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1cb7a0b5-2a0c-4f34-b078-c0f8f7ee2ca9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:23.377459 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1cb7a0b5-2a0c-4f34-b078-c0f8f7ee2ca9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:23.377913 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1cb7a0b5-2a0c-4f34-b078-c0f8f7ee2ca9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:23.378703 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1cb7a0b5-2a0c-4f34-b078-c0f8f7ee2ca9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:23.379145 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1cb7a0b5-2a0c-4f34-b078-c0f8f7ee2ca9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:23.503433 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-1cb7a0b5-2a0c-4f34-b078-c0f8f7ee2ca9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] HTTP exception thrown: Cannot 'detach_volume' instance 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c while it is in vm_state rescued Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1cb7a0b5-2a0c-4f34-b078-c0f8f7ee2ca9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Request method failure captured: Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: DELETE /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c/os-volume_attachments/9153a431-81fa-4f4d-b244-d22c2076bd5b HTTP/1.1 Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TVCnySq6CLsGu14_jXdA3WytN6REAzlZ9z0bzJWssteHdmInuzuZUdGNc86Ke3JhB3QF1B_ZB_UdLaErT_h4DfqeItC-W52HuLPerj8sPcNbz8-ulzFH1oOz92uhvmlKKusyUoKFDiEP5YG5vAvdfYGSrhS-nVsJMhPPp4r17NoIg Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: b017c2881aba4df6afe70cdcb84d5ee8 Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1574229167 Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:04:23.505077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:04:23.506651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b017c2881aba4df6afe70cdcb84d5ee8", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b017c2881aba4df6afe70cdcb84d5ee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b017c2881aba4df6afe70cdcb84d5ee8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b017c2881aba4df6afe70cdcb84d5ee8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:04:23.506651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1574229167 Jun 16 15:04:23.506651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: b017c2881aba4df6afe70cdcb84d5ee8 Jun 16 15:04:23.506651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1574229167 Jun 16 15:04:23.506651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-ServerRescueNegativeTestJSON-1574229167-project Jun 16 15:04:23.506651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:04:23.506651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:04:23.506651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 73a51a4e876e4910bbc5dd69f8a18058 Jun 16 15:04:23.506651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1574229167-project Jun 16 15:04:23.506651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:04:23.506651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Cannot 'detach_volume' instance 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c while it is in vm_state rescued Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'server_id': '3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c', 'id': '9153a431-81fa-4f4d-b244-d22c2076bd5b'} Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:04:23.507904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:04:23.509437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 15:04:23.509437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 15:04:23.509437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 15:04:23.509437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 15:04:23.509437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c while it is in vm_state rescued Jun 16 15:04:23.509437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:04:23.509437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:04:23.509437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:04:23.509437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:23.509437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:04:23.509437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:04:23.509437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:04:23.509437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:04:23.509437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c while it is in vm_state rescued Jun 16 15:04:23.509437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:04:23.509437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1cb7a0b5-2a0c-4f34-b078-c0f8f7ee2ca9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Returning 409 to user: Cannot 'detach_volume' instance 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c while it is in vm_state rescued {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:04:23.510619 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1cb7a0b5-2a0c-4f34-b078-c0f8f7ee2ca9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c/os-volume_attachments/9153a431-81fa-4f4d-b244-d22c2076bd5b" status: 409 len: 152 microversion: 2.1 time: 0.140245 Jun 16 15:04:23.510619 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 433/865] 10.222.0.72 () {58 vars in 1415 bytes} [Thu Jun 16 15:04:23 2022] DELETE /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c/os-volume_attachments/9153a431-81fa-4f4d-b244-d22c2076bd5b => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 15:04:23.516171 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-85416d78-ed06-4190-95f1-c0f8faf50b2a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:23.516705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-85416d78-ed06-4190-95f1-c0f8faf50b2a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:23.518571 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:23.524625 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85416d78-ed06-4190-95f1-c0f8faf50b2a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:23.525100 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85416d78-ed06-4190-95f1-c0f8faf50b2a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:23.525862 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85416d78-ed06-4190-95f1-c0f8faf50b2a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:23.526290 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85416d78-ed06-4190-95f1-c0f8faf50b2a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:23.594648 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-85416d78-ed06-4190-95f1-c0f8faf50b2a tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "POST /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c/action" status: 202 len: 0 microversion: 2.1 time: 0.082191 Jun 16 15:04:23.595481 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 433/866] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Jun 16 15:04:23 2022] POST /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:04:23.603674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c9b31df8-5926-48f2-a09a-04b55f55ecb2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:23.604292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c9b31df8-5926-48f2-a09a-04b55f55ecb2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:23.611217 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9b31df8-5926-48f2-a09a-04b55f55ecb2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:23.611673 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9b31df8-5926-48f2-a09a-04b55f55ecb2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:23.612445 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9b31df8-5926-48f2-a09a-04b55f55ecb2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:23.612915 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9b31df8-5926-48f2-a09a-04b55f55ecb2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:23.665841 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f8105d8e-4e5f-43a3-9d72-1f20eb322d3b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:23.666531 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f8105d8e-4e5f-43a3-9d72-1f20eb322d3b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:23.673148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f8105d8e-4e5f-43a3-9d72-1f20eb322d3b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:23.673600 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f8105d8e-4e5f-43a3-9d72-1f20eb322d3b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:23.674362 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f8105d8e-4e5f-43a3-9d72-1f20eb322d3b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:23.674809 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f8105d8e-4e5f-43a3-9d72-1f20eb322d3b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:23.678913 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:23.742953 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c9b31df8-5926-48f2-a09a-04b55f55ecb2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:23.751057 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c9b31df8-5926-48f2-a09a-04b55f55ecb2 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1724 microversion: 2.1 time: 0.151266 Jun 16 15:04:23.751630 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 434/867] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:23 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:23.811363 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f8105d8e-4e5f-43a3-9d72-1f20eb322d3b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:23.818912 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f8105d8e-4e5f-43a3-9d72-1f20eb322d3b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1266 microversion: 2.1 time: 0.157256 Jun 16 15:04:23.819458 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 434/868] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:23 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:24.769619 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-84a5bf71-e86b-483f-862f-990c91694c0f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:24.770231 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-84a5bf71-e86b-483f-862f-990c91694c0f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:24.777041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-84a5bf71-e86b-483f-862f-990c91694c0f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:24.777492 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-84a5bf71-e86b-483f-862f-990c91694c0f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:24.778256 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-84a5bf71-e86b-483f-862f-990c91694c0f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:24.778698 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-84a5bf71-e86b-483f-862f-990c91694c0f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:24.836113 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-00c19ed3-dea5-4ac9-bcba-9482c7b739d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:24.837547 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-00c19ed3-dea5-4ac9-bcba-9482c7b739d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:24.844250 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-00c19ed3-dea5-4ac9-bcba-9482c7b739d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:24.845263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-00c19ed3-dea5-4ac9-bcba-9482c7b739d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:24.845404 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-00c19ed3-dea5-4ac9-bcba-9482c7b739d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:24.845807 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-00c19ed3-dea5-4ac9-bcba-9482c7b739d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:24.912684 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-84a5bf71-e86b-483f-862f-990c91694c0f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:24.921026 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-84a5bf71-e86b-483f-862f-990c91694c0f tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1724 microversion: 2.1 time: 0.155313 Jun 16 15:04:24.921599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 435/869] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:24 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:24.979612 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-00c19ed3-dea5-4ac9-bcba-9482c7b739d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:24.987277 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-00c19ed3-dea5-4ac9-bcba-9482c7b739d6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1266 microversion: 2.1 time: 0.154921 Jun 16 15:04:24.988061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 435/870] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:24 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:25.937794 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-36dae3d2-d05c-41ea-8ed0-c8d2f071a3ed tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:25.938386 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-36dae3d2-d05c-41ea-8ed0-c8d2f071a3ed tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:25.945591 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-36dae3d2-d05c-41ea-8ed0-c8d2f071a3ed tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:25.946051 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-36dae3d2-d05c-41ea-8ed0-c8d2f071a3ed tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:25.946820 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-36dae3d2-d05c-41ea-8ed0-c8d2f071a3ed tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:25.947258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-36dae3d2-d05c-41ea-8ed0-c8d2f071a3ed tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:26.004805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9be7bc18-1d79-4999-ac64-40928a5917d1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:26.005634 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9be7bc18-1d79-4999-ac64-40928a5917d1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:26.014481 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9be7bc18-1d79-4999-ac64-40928a5917d1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:26.014938 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9be7bc18-1d79-4999-ac64-40928a5917d1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:26.015999 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9be7bc18-1d79-4999-ac64-40928a5917d1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:26.016486 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9be7bc18-1d79-4999-ac64-40928a5917d1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:26.103552 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-36dae3d2-d05c-41ea-8ed0-c8d2f071a3ed tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:26.113033 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-36dae3d2-d05c-41ea-8ed0-c8d2f071a3ed tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1724 microversion: 2.1 time: 0.178885 Jun 16 15:04:26.113993 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 436/871] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:25 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:26.176392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9be7bc18-1d79-4999-ac64-40928a5917d1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:26.184177 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9be7bc18-1d79-4999-ac64-40928a5917d1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1266 microversion: 2.1 time: 0.184352 Jun 16 15:04:26.184932 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 436/872] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:25 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:27.129706 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-eb0f3be1-a087-462c-83fe-f37133047a4d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:27.130318 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-eb0f3be1-a087-462c-83fe-f37133047a4d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:27.137036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eb0f3be1-a087-462c-83fe-f37133047a4d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:27.137422 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eb0f3be1-a087-462c-83fe-f37133047a4d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:27.138185 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eb0f3be1-a087-462c-83fe-f37133047a4d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:27.138624 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eb0f3be1-a087-462c-83fe-f37133047a4d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:27.202115 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-026dbbf9-1515-4c95-9dc4-862a74905216 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:27.203377 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-026dbbf9-1515-4c95-9dc4-862a74905216 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:27.210093 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-026dbbf9-1515-4c95-9dc4-862a74905216 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:27.210541 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-026dbbf9-1515-4c95-9dc4-862a74905216 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:27.211380 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-026dbbf9-1515-4c95-9dc4-862a74905216 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:27.211811 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-026dbbf9-1515-4c95-9dc4-862a74905216 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:27.284822 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-eb0f3be1-a087-462c-83fe-f37133047a4d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:27.293708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-eb0f3be1-a087-462c-83fe-f37133047a4d tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1724 microversion: 2.1 time: 0.167862 Jun 16 15:04:27.296383 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 437/873] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:27 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:27.358004 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-026dbbf9-1515-4c95-9dc4-862a74905216 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:27.365704 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-026dbbf9-1515-4c95-9dc4-862a74905216 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1266 microversion: 2.1 time: 0.168434 Jun 16 15:04:27.366366 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 437/874] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:27 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:28.311513 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-966b60c6-aaf3-4bdb-bdca-404c36a42408 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:28.312123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-966b60c6-aaf3-4bdb-bdca-404c36a42408 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:28.318660 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-966b60c6-aaf3-4bdb-bdca-404c36a42408 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:28.319116 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-966b60c6-aaf3-4bdb-bdca-404c36a42408 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:28.319871 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-966b60c6-aaf3-4bdb-bdca-404c36a42408 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:28.320307 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-966b60c6-aaf3-4bdb-bdca-404c36a42408 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:28.382514 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-386d9872-d8cd-43d4-ba5f-9d6d7a5cdb6f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:28.383137 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-386d9872-d8cd-43d4-ba5f-9d6d7a5cdb6f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:28.390387 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-386d9872-d8cd-43d4-ba5f-9d6d7a5cdb6f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:28.390835 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-386d9872-d8cd-43d4-ba5f-9d6d7a5cdb6f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:28.391614 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-386d9872-d8cd-43d4-ba5f-9d6d7a5cdb6f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:28.392036 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-386d9872-d8cd-43d4-ba5f-9d6d7a5cdb6f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:28.456671 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-966b60c6-aaf3-4bdb-bdca-404c36a42408 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:28.464862 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-966b60c6-aaf3-4bdb-bdca-404c36a42408 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1724 microversion: 2.1 time: 0.157188 Jun 16 15:04:28.465438 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 438/875] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:28 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:28.526430 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-386d9872-d8cd-43d4-ba5f-9d6d7a5cdb6f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:28.534222 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-386d9872-d8cd-43d4-ba5f-9d6d7a5cdb6f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1266 microversion: 2.1 time: 0.155608 Jun 16 15:04:28.534786 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 438/876] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:28 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:29.109588 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-dc565839-6a94-4088-9617-341d8f739ece req-65572cfb-eac1-46bd-9c33-62578a649113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b26a44-c528-4cc8-b427-f43d8f0bc9a9", "name": "network-vif-plugged", "status": "completed", "tag": "cc43f90e-a572-4f83-9de1-aec44e329893"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:29.117789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-dc565839-6a94-4088-9617-341d8f739ece req-65572cfb-eac1-46bd-9c33-62578a649113 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:29.118293 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-dc565839-6a94-4088-9617-341d8f739ece req-65572cfb-eac1-46bd-9c33-62578a649113 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:29.130165 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-dc565839-6a94-4088-9617-341d8f739ece req-65572cfb-eac1-46bd-9c33-62578a649113 service nova] Creating event network-vif-plugged:cc43f90e-a572-4f83-9de1-aec44e329893 for instance c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 on hv-cinder-83716 Jun 16 15:04:29.135223 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-dc565839-6a94-4088-9617-341d8f739ece req-65572cfb-eac1-46bd-9c33-62578a649113 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029144 Jun 16 15:04:29.136108 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 439/877] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:29.482342 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-42939c82-1c47-4b24-959f-9506af564dc9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:29.482928 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-42939c82-1c47-4b24-959f-9506af564dc9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:29.489318 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-42939c82-1c47-4b24-959f-9506af564dc9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:29.489768 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-42939c82-1c47-4b24-959f-9506af564dc9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:29.490528 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-42939c82-1c47-4b24-959f-9506af564dc9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:29.490961 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-42939c82-1c47-4b24-959f-9506af564dc9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:29.553974 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fc9713ce-eef0-4874-bf97-662a7b2e507f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:29.554372 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fc9713ce-eef0-4874-bf97-662a7b2e507f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:29.560955 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fc9713ce-eef0-4874-bf97-662a7b2e507f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:29.561420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fc9713ce-eef0-4874-bf97-662a7b2e507f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:29.562195 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fc9713ce-eef0-4874-bf97-662a7b2e507f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:29.562814 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fc9713ce-eef0-4874-bf97-662a7b2e507f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:29.582274 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:29.627587 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-42939c82-1c47-4b24-959f-9506af564dc9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:29.637399 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-42939c82-1c47-4b24-959f-9506af564dc9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1724 microversion: 2.1 time: 0.158921 Jun 16 15:04:29.638310 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 439/878] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:29 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:29.717146 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-fc9713ce-eef0-4874-bf97-662a7b2e507f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:29.724703 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fc9713ce-eef0-4874-bf97-662a7b2e507f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1266 microversion: 2.1 time: 0.176862 Jun 16 15:04:29.725302 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 440/879] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:29 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:30.654905 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a30671ac-b911-4a27-b762-667f21037e53 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:30.655818 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a30671ac-b911-4a27-b762-667f21037e53 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:30.662793 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a30671ac-b911-4a27-b762-667f21037e53 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:30.663179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a30671ac-b911-4a27-b762-667f21037e53 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:30.664117 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a30671ac-b911-4a27-b762-667f21037e53 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:30.664561 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a30671ac-b911-4a27-b762-667f21037e53 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:30.740775 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-08f91e85-55fc-47ad-b745-3f97d22b70be tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:30.741557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-08f91e85-55fc-47ad-b745-3f97d22b70be tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:30.748389 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-08f91e85-55fc-47ad-b745-3f97d22b70be tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:30.748962 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-08f91e85-55fc-47ad-b745-3f97d22b70be tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:30.749800 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-08f91e85-55fc-47ad-b745-3f97d22b70be tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:30.750330 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-08f91e85-55fc-47ad-b745-3f97d22b70be tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:30.807143 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a30671ac-b911-4a27-b762-667f21037e53 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:30.818694 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a30671ac-b911-4a27-b762-667f21037e53 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1730 microversion: 2.1 time: 0.167546 Jun 16 15:04:30.819375 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 440/880] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:30 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:30.835761 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-174168fd-b284-444c-8945-82127011bfe4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:30.836267 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-174168fd-b284-444c-8945-82127011bfe4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:30.843086 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-174168fd-b284-444c-8945-82127011bfe4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:30.843531 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-174168fd-b284-444c-8945-82127011bfe4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:30.844297 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-174168fd-b284-444c-8945-82127011bfe4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:30.844766 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-174168fd-b284-444c-8945-82127011bfe4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:30.888373 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-08f91e85-55fc-47ad-b745-3f97d22b70be tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:30.896323 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-08f91e85-55fc-47ad-b745-3f97d22b70be tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1266 microversion: 2.1 time: 0.159425 Jun 16 15:04:30.896996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 441/881] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:30 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:30.926303 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-174168fd-b284-444c-8945-82127011bfe4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094426 Jun 16 15:04:30.927040 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 441/882] 10.222.0.72 () {58 vars in 1274 bytes} [Thu Jun 16 15:04:30 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:04:31.023248 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-06a865be-bc02-4ceb-a33d-fd735e3167c1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:31.023744 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-06a865be-bc02-4ceb-a33d-fd735e3167c1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:31.030374 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06a865be-bc02-4ceb-a33d-fd735e3167c1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:31.031087 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06a865be-bc02-4ceb-a33d-fd735e3167c1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:31.031856 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06a865be-bc02-4ceb-a33d-fd735e3167c1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:31.032304 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06a865be-bc02-4ceb-a33d-fd735e3167c1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:31.057520 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-06a865be-bc02-4ceb-a33d-fd735e3167c1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed/ips" status: 200 len: 150 microversion: 2.1 time: 0.038235 Jun 16 15:04:31.058092 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 442/883] 10.222.0.72 () {58 vars in 1247 bytes} [Thu Jun 16 15:04:31 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:31.068643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-966db74c-9851-424e-b56a-703e4aa17c57 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6e8f3dc-47cf-43ad-a5a1-136b787019ea"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:31.069931 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-966db74c-9851-424e-b56a-703e4aa17c57 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:31.076700 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-966db74c-9851-424e-b56a-703e4aa17c57 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:31.077198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-966db74c-9851-424e-b56a-703e4aa17c57 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:31.077978 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-966db74c-9851-424e-b56a-703e4aa17c57 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:31.078407 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-966db74c-9851-424e-b56a-703e4aa17c57 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:31.158389 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-966db74c-9851-424e-b56a-703e4aa17c57 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] HTTP exception thrown: Invalid volume: volume f6e8f3dc-47cf-43ad-a5a1-136b787019ea is already attached to instances: 133e2287-518a-4c4e-bb51-8790ed7647a7 Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-966db74c-9851-424e-b56a-703e4aa17c57 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Request method failure captured: Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: POST /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed/os-volume_attachments HTTP/1.1 Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 74 Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0TU2Gjo7bUkrQIinrAEmUizdcavVo4cOx7_e9CBdhqQMOL_HN88fbcSkNjz0fxmjx2YzvDmjFBGY4yiPbtaUHC4qF4lZPrXQHcA8kaogkzbM_Pr4t5ixnvBhbj3OMnQtdL4-hEGTH3GzOC14o5hpUT2K4iK3ilxCwb3lslIqMZDzIU Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 15:04:31.160316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 15:04:31.161756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2940b81a86c2401db1aa432d9a0735eb", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:04:31.161756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:04:31.161756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:04:31.161756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:04:31.161756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:04:31.161756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 15:04:31.161756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 15:04:31.161756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: 0b8be0ab53ae48af844bc281dee5f77c Jun 16 15:04:31.161756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:04:31.161756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Jun 16 15:04:31.161756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {"volumeAttachment": {"volumeId": "f6e8f3dc-47cf-43ad-a5a1-136b787019ea"}} Jun 16 15:04:31.161756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 15:04:31.162535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Invalid volume: volume f6e8f3dc-47cf-43ad-a5a1-136b787019ea is already attached to instances: 133e2287-518a-4c4e-bb51-8790ed7647a7 Jun 16 15:04:31.162535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'server_id': 'a6a310ce-a575-4379-9390-2b4ad718e3ed', 'body': {'volumeAttachment': {'volumeId': 'f6e8f3dc-47cf-43ad-a5a1-136b787019ea'}}} Jun 16 15:04:31.162535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:04:31.162535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:31.162535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 15:04:31.162535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 15:04:31.162535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 15:04:31.162535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 15:04:31.162535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 15:04:31.162535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 15:04:31.162535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 15:04:31.162535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 15:04:31.162535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 15:04:31.162535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 15:04:31.162535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f6e8f3dc-47cf-43ad-a5a1-136b787019ea is already attached to instances: 133e2287-518a-4c4e-bb51-8790ed7647a7 Jun 16 15:04:31.162535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:31.162535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:04:31.162535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:31.162535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f6e8f3dc-47cf-43ad-a5a1-136b787019ea is already attached to instances: 133e2287-518a-4c4e-bb51-8790ed7647a7 Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:31.164050 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:04:31.165286 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:04:31.165286 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:04:31.165286 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:04:31.165286 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f6e8f3dc-47cf-43ad-a5a1-136b787019ea is already attached to instances: 133e2287-518a-4c4e-bb51-8790ed7647a7 Jun 16 15:04:31.165286 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:31.165286 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-966db74c-9851-424e-b56a-703e4aa17c57 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Returning 400 to user: Invalid volume: volume f6e8f3dc-47cf-43ad-a5a1-136b787019ea is already attached to instances: 133e2287-518a-4c4e-bb51-8790ed7647a7 {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:04:31.165286 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-966db74c-9851-424e-b56a-703e4aa17c57 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "POST /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097590 Jun 16 15:04:31.165286 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 442/884] 10.222.0.72 () {60 vars in 1322 bytes} [Thu Jun 16 15:04:31 2022] POST /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 15:04:31.171322 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b3dfff76-5b95-456a-8c53-2d7aaf6f8483 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:31.171816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b3dfff76-5b95-456a-8c53-2d7aaf6f8483 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:31.178154 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3dfff76-5b95-456a-8c53-2d7aaf6f8483 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:31.178517 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3dfff76-5b95-456a-8c53-2d7aaf6f8483 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:31.179283 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3dfff76-5b95-456a-8c53-2d7aaf6f8483 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:31.179717 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3dfff76-5b95-456a-8c53-2d7aaf6f8483 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:31.208015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b3dfff76-5b95-456a-8c53-2d7aaf6f8483 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:04:31.283191 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b3dfff76-5b95-456a-8c53-2d7aaf6f8483 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 204 len: 0 microversion: 2.1 time: 0.115448 Jun 16 15:04:31.283786 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 443/885] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:04:31 2022] DELETE /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:04:31.291992 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-84c530cd-28e5-4e91-a3d9-aa4fffd3b43b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:31.292742 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-84c530cd-28e5-4e91-a3d9-aa4fffd3b43b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:31.299895 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-84c530cd-28e5-4e91-a3d9-aa4fffd3b43b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:31.300373 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-84c530cd-28e5-4e91-a3d9-aa4fffd3b43b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:31.301167 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-84c530cd-28e5-4e91-a3d9-aa4fffd3b43b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:31.301608 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-84c530cd-28e5-4e91-a3d9-aa4fffd3b43b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:31.530119 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-84c530cd-28e5-4e91-a3d9-aa4fffd3b43b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:31.538008 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-84c530cd-28e5-4e91-a3d9-aa4fffd3b43b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 200 len: 1680 microversion: 2.1 time: 0.249785 Jun 16 15:04:31.538805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 443/886] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:31 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 1680 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:31.913981 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-37fbf89a-499a-4e9d-8018-0c5f2bb88c6a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:31.914622 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-37fbf89a-499a-4e9d-8018-0c5f2bb88c6a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:31.925479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-37fbf89a-499a-4e9d-8018-0c5f2bb88c6a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:31.925938 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-37fbf89a-499a-4e9d-8018-0c5f2bb88c6a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:31.926754 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-37fbf89a-499a-4e9d-8018-0c5f2bb88c6a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:31.927190 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-37fbf89a-499a-4e9d-8018-0c5f2bb88c6a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:31.947639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-b1d3adc6-408e-4419-8732-f22dee5663fa req-40b01d64-00ae-4754-a159-b8aefb6e6de0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c", "tag": "105d0fb0-e762-4bda-8533-5abf36bb8069"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:31.952262 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:31.957051 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-b1d3adc6-408e-4419-8732-f22dee5663fa req-40b01d64-00ae-4754-a159-b8aefb6e6de0 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:31.958021 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-b1d3adc6-408e-4419-8732-f22dee5663fa req-40b01d64-00ae-4754-a159-b8aefb6e6de0 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:31.971317 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-b1d3adc6-408e-4419-8732-f22dee5663fa req-40b01d64-00ae-4754-a159-b8aefb6e6de0 service nova] Creating event network-changed:105d0fb0-e762-4bda-8533-5abf36bb8069 for instance 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c on hv-cinder-83716 Jun 16 15:04:31.976672 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-b1d3adc6-408e-4419-8732-f22dee5663fa req-40b01d64-00ae-4754-a159-b8aefb6e6de0 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096966 Jun 16 15:04:31.977340 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 444/887] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:32.068323 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-37fbf89a-499a-4e9d-8018-0c5f2bb88c6a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:32.076282 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-37fbf89a-499a-4e9d-8018-0c5f2bb88c6a tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1266 microversion: 2.1 time: 0.166135 Jun 16 15:04:32.076758 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 444/888] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:31 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:32.556400 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e2ec5dae-f00f-45dd-97c7-703b2e37b31e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:32.557142 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e2ec5dae-f00f-45dd-97c7-703b2e37b31e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:32.563823 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2ec5dae-f00f-45dd-97c7-703b2e37b31e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:32.564302 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2ec5dae-f00f-45dd-97c7-703b2e37b31e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:32.565110 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2ec5dae-f00f-45dd-97c7-703b2e37b31e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:32.565549 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2ec5dae-f00f-45dd-97c7-703b2e37b31e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:32.702614 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e2ec5dae-f00f-45dd-97c7-703b2e37b31e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:32.710543 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e2ec5dae-f00f-45dd-97c7-703b2e37b31e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 200 len: 1680 microversion: 2.1 time: 0.158564 Jun 16 15:04:32.711263 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 445/889] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:32 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:33.093343 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f79e3770-3739-4a8f-b82f-70e00530cab4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:33.093954 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f79e3770-3739-4a8f-b82f-70e00530cab4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:33.100409 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f79e3770-3739-4a8f-b82f-70e00530cab4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:33.100891 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f79e3770-3739-4a8f-b82f-70e00530cab4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:33.101654 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f79e3770-3739-4a8f-b82f-70e00530cab4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:33.102091 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f79e3770-3739-4a8f-b82f-70e00530cab4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:33.246526 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f79e3770-3739-4a8f-b82f-70e00530cab4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:33.254002 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f79e3770-3739-4a8f-b82f-70e00530cab4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1266 microversion: 2.1 time: 0.164487 Jun 16 15:04:33.254552 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 445/890] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:33 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:33.735664 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-62cdae74-9faf-4b93-8e3a-342bfdaf0215 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:33.736282 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-62cdae74-9faf-4b93-8e3a-342bfdaf0215 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:33.742985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-62cdae74-9faf-4b93-8e3a-342bfdaf0215 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:33.743375 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-62cdae74-9faf-4b93-8e3a-342bfdaf0215 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:33.744143 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-62cdae74-9faf-4b93-8e3a-342bfdaf0215 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:33.744576 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-62cdae74-9faf-4b93-8e3a-342bfdaf0215 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:33.873706 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-62cdae74-9faf-4b93-8e3a-342bfdaf0215 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:33.881676 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-62cdae74-9faf-4b93-8e3a-342bfdaf0215 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 200 len: 1680 microversion: 2.1 time: 0.149791 Jun 16 15:04:33.882452 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 446/891] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:33 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:34.005831 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-7005c65d-fe1b-404b-a5bf-3dba58cb9a03 req-f45e7726-80ac-4e4e-93b7-530f9303c2ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c", "tag": "105d0fb0-e762-4bda-8533-5abf36bb8069"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:34.014616 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-7005c65d-fe1b-404b-a5bf-3dba58cb9a03 req-f45e7726-80ac-4e4e-93b7-530f9303c2ea service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:34.015053 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-7005c65d-fe1b-404b-a5bf-3dba58cb9a03 req-f45e7726-80ac-4e4e-93b7-530f9303c2ea service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:34.026369 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-7005c65d-fe1b-404b-a5bf-3dba58cb9a03 req-f45e7726-80ac-4e4e-93b7-530f9303c2ea service nova] Creating event network-changed:105d0fb0-e762-4bda-8533-5abf36bb8069 for instance 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c on hv-cinder-83716 Jun 16 15:04:34.031600 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-7005c65d-fe1b-404b-a5bf-3dba58cb9a03 req-f45e7726-80ac-4e4e-93b7-530f9303c2ea service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029577 Jun 16 15:04:34.032172 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 446/892] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:34.271177 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-93beb418-28d8-4a8f-8419-838fddf35082 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:34.271855 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-93beb418-28d8-4a8f-8419-838fddf35082 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:34.278403 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93beb418-28d8-4a8f-8419-838fddf35082 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:34.278852 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93beb418-28d8-4a8f-8419-838fddf35082 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:34.279627 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93beb418-28d8-4a8f-8419-838fddf35082 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:34.280191 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93beb418-28d8-4a8f-8419-838fddf35082 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:34.552516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-93beb418-28d8-4a8f-8419-838fddf35082 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:34.561019 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-93beb418-28d8-4a8f-8419-838fddf35082 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1452 microversion: 2.1 time: 0.293695 Jun 16 15:04:34.561684 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 447/893] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:34 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1452 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:34.577798 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-204dba0b-c5ec-4ea2-843d-9bed0876c1f1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:34.578503 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-204dba0b-c5ec-4ea2-843d-9bed0876c1f1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:34.584919 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-204dba0b-c5ec-4ea2-843d-9bed0876c1f1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:34.585624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-204dba0b-c5ec-4ea2-843d-9bed0876c1f1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:34.586400 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-204dba0b-c5ec-4ea2-843d-9bed0876c1f1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:34.586872 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-204dba0b-c5ec-4ea2-843d-9bed0876c1f1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:34.726732 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e1f1eaca-db7f-4fd9-b7fb-b7525a1b5d68 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:34.727217 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e1f1eaca-db7f-4fd9-b7fb-b7525a1b5d68 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:34.732274 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-204dba0b-c5ec-4ea2-843d-9bed0876c1f1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:34.733900 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e1f1eaca-db7f-4fd9-b7fb-b7525a1b5d68 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:34.734359 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e1f1eaca-db7f-4fd9-b7fb-b7525a1b5d68 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:34.735134 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e1f1eaca-db7f-4fd9-b7fb-b7525a1b5d68 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:34.735591 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e1f1eaca-db7f-4fd9-b7fb-b7525a1b5d68 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:34.748382 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-204dba0b-c5ec-4ea2-843d-9bed0876c1f1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1452 microversion: 2.1 time: 0.174883 Jun 16 15:04:34.749443 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 447/894] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:34 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:34.821745 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-e1f1eaca-db7f-4fd9-b7fb-b7525a1b5d68 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lazy-loading 'services' on Instance uuid 34992108-bb48-4184-88ee-43907b8b14a3 {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:04:34.900015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d49f101b-7899-4934-8699-c25b5d4e3191 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:34.900737 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d49f101b-7899-4934-8699-c25b5d4e3191 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:34.907869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d49f101b-7899-4934-8699-c25b5d4e3191 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:34.908342 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d49f101b-7899-4934-8699-c25b5d4e3191 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:34.909157 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d49f101b-7899-4934-8699-c25b5d4e3191 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:34.909593 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d49f101b-7899-4934-8699-c25b5d4e3191 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:34.974984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e1f1eaca-db7f-4fd9-b7fb-b7525a1b5d68 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "DELETE /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3/os-volume_attachments/a59ccd73-606d-4e9c-ba6e-505490a7f12e" status: 202 len: 0 microversion: 2.1 time: 0.380197 Jun 16 15:04:34.979705 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 448/895] 10.222.0.72 () {58 vars in 1415 bytes} [Thu Jun 16 15:04:34 2022] DELETE /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3/os-volume_attachments/a59ccd73-606d-4e9c-ba6e-505490a7f12e => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:04:35.182595 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d49f101b-7899-4934-8699-c25b5d4e3191 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:35.192372 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d49f101b-7899-4934-8699-c25b5d4e3191 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 200 len: 1680 microversion: 2.1 time: 0.296595 Jun 16 15:04:35.202938 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 448/896] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:34 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 1680 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:35.718486 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-1a5aba7d-76b6-4ce2-865f-566cdc309032 req-551b3c90-e2c5-4548-b115-4c7ef75bf023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6a310ce-a575-4379-9390-2b4ad718e3ed", "name": "network-vif-deleted", "tag": "81f49aec-659a-46a4-b41a-827750fcd2ce"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:35.732433 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-1a5aba7d-76b6-4ce2-865f-566cdc309032 req-551b3c90-e2c5-4548-b115-4c7ef75bf023 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:35.737934 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-1a5aba7d-76b6-4ce2-865f-566cdc309032 req-551b3c90-e2c5-4548-b115-4c7ef75bf023 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:35.748808 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-1a5aba7d-76b6-4ce2-865f-566cdc309032 req-551b3c90-e2c5-4548-b115-4c7ef75bf023 service nova] Creating event network-vif-deleted:81f49aec-659a-46a4-b41a-827750fcd2ce for instance a6a310ce-a575-4379-9390-2b4ad718e3ed on hv-cinder-83716 Jun 16 15:04:35.754000 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-1a5aba7d-76b6-4ce2-865f-566cdc309032 req-551b3c90-e2c5-4548-b115-4c7ef75bf023 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046964 Jun 16 15:04:35.755320 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 449/897] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:36.213143 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-689e830a-bc2e-439c-9151-e735ef6aae17 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:36.214977 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-689e830a-bc2e-439c-9151-e735ef6aae17 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:36.225636 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-689e830a-bc2e-439c-9151-e735ef6aae17 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:36.226555 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-689e830a-bc2e-439c-9151-e735ef6aae17 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:36.229118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-689e830a-bc2e-439c-9151-e735ef6aae17 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:36.229823 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-689e830a-bc2e-439c-9151-e735ef6aae17 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:36.275775 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-689e830a-bc2e-439c-9151-e735ef6aae17 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:36.277267 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-689e830a-bc2e-439c-9151-e735ef6aae17 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:36.277957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-689e830a-bc2e-439c-9151-e735ef6aae17 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lazy-loading 'fault' on Instance uuid a6a310ce-a575-4379-9390-2b4ad718e3ed {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:04:36.342700 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-689e830a-bc2e-439c-9151-e735ef6aae17 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:36.353650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-689e830a-bc2e-439c-9151-e735ef6aae17 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 200 len: 1330 microversion: 2.1 time: 0.146873 Jun 16 15:04:36.354221 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 449/898] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:36 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 1330 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:36.663066 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-84df3565-29d5-4d7d-8ceb-9662726c2afd req-b8df86af-3fb7-405b-8b2c-a62f39889512 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b26a44-c528-4cc8-b427-f43d8f0bc9a9", "tag": "cc43f90e-a572-4f83-9de1-aec44e329893"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:36.675726 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-84df3565-29d5-4d7d-8ceb-9662726c2afd req-b8df86af-3fb7-405b-8b2c-a62f39889512 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:36.676267 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-84df3565-29d5-4d7d-8ceb-9662726c2afd req-b8df86af-3fb7-405b-8b2c-a62f39889512 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:36.692733 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-84df3565-29d5-4d7d-8ceb-9662726c2afd req-b8df86af-3fb7-405b-8b2c-a62f39889512 service nova] Creating event network-changed:cc43f90e-a572-4f83-9de1-aec44e329893 for instance c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 on hv-cinder-83716 Jun 16 15:04:36.699164 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-84df3565-29d5-4d7d-8ceb-9662726c2afd req-b8df86af-3fb7-405b-8b2c-a62f39889512 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040539 Jun 16 15:04:36.700373 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 450/899] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:37.160048 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d3b39e0a-48bd-4233-800a-563f7632163e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:37.166877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d3b39e0a-48bd-4233-800a-563f7632163e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:37.167410 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d3b39e0a-48bd-4233-800a-563f7632163e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:37.194459 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d3b39e0a-48bd-4233-800a-563f7632163e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Going to try to stop instance {{(pid=124589) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 15:04:37.229479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:37.253785 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d3b39e0a-48bd-4233-800a-563f7632163e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "POST /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3/action" status: 202 len: 0 microversion: 2.1 time: 0.097927 Jun 16 15:04:37.254658 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 450/900] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Jun 16 15:04:37 2022] POST /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:04:37.265598 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fe66e6d8-c637-41f0-a344-f7d6223fb2c2 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:37.266560 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fe66e6d8-c637-41f0-a344-f7d6223fb2c2 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:37.275473 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fe66e6d8-c637-41f0-a344-f7d6223fb2c2 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:37.276251 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fe66e6d8-c637-41f0-a344-f7d6223fb2c2 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:37.277638 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fe66e6d8-c637-41f0-a344-f7d6223fb2c2 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:37.278279 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fe66e6d8-c637-41f0-a344-f7d6223fb2c2 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:37.371572 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1913cdbf-0f94-472d-ad72-771d0f07a9d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:37.372607 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1913cdbf-0f94-472d-ad72-771d0f07a9d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:37.378964 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1913cdbf-0f94-472d-ad72-771d0f07a9d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:37.379421 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1913cdbf-0f94-472d-ad72-771d0f07a9d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:37.380200 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1913cdbf-0f94-472d-ad72-771d0f07a9d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:37.380639 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1913cdbf-0f94-472d-ad72-771d0f07a9d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:37.404034 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-1913cdbf-0f94-472d-ad72-771d0f07a9d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] HTTP exception thrown: Instance a6a310ce-a575-4379-9390-2b4ad718e3ed could not be found. Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1913cdbf-0f94-472d-ad72-771d0f07a9d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Request method failure captured: Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed HTTP/1.1 Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0TU2Gjo7bUkrQIinrAEmUizdcavVo4cOx7_e9CBdhqQMOL_HN88fbcSkNjz0fxmjx2YzvDmjFBGY4yiPbtaUHC4qF4lZPrXQHcA8kaogkzbM_Pr4t5ixnvBhbj3OMnQtdL4-hEGTH3GzOC14o5hpUT2K4iK3ilxCwb3lslIqMZDzIU Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 15:04:37.407484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 15:04:37.409233 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2940b81a86c2401db1aa432d9a0735eb", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:04:37.409233 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:04:37.409233 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:04:37.409233 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:04:37.409233 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:04:37.409233 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 15:04:37.409233 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 15:04:37.409233 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: 0b8be0ab53ae48af844bc281dee5f77c Jun 16 15:04:37.409233 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:04:37.409233 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 15:04:37.409233 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance a6a310ce-a575-4379-9390-2b4ad718e3ed could not be found. Jun 16 15:04:37.409233 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': 'a6a310ce-a575-4379-9390-2b4ad718e3ed'} Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6a310ce-a575-4379-9390-2b4ad718e3ed could not be found. Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:04:37.410081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:04:37.411385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:04:37.411385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:04:37.411385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:04:37.411385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:04:37.411385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:04:37.411385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:04:37.411385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:04:37.411385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6a310ce-a575-4379-9390-2b4ad718e3ed could not be found. Jun 16 15:04:37.411385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:37.411385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:04:37.411385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:37.411385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:37.411385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:04:37.411385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:04:37.411385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:04:37.411385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:04:37.411385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6a310ce-a575-4379-9390-2b4ad718e3ed could not be found. Jun 16 15:04:37.411385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:37.412966 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1913cdbf-0f94-472d-ad72-771d0f07a9d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Returning 404 to user: Instance a6a310ce-a575-4379-9390-2b4ad718e3ed could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:04:37.415595 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1913cdbf-0f94-472d-ad72-771d0f07a9d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 404 len: 111 microversion: 2.1 time: 0.047747 Jun 16 15:04:37.419495 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 451/901] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:37 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 15:04:37.425767 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3cde1315-514c-4467-a3f1-3266fa7a9f28 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '.version_select at 0x7faaba9bcf70>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:37.456368 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3cde1315-514c-4467-a3f1-3266fa7a9f28 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-886657474" status: 202 len: 0 microversion: 2.1 time: 0.035243 Jun 16 15:04:37.457313 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 452/902] 10.222.0.72 () {58 vars in 1217 bytes} [Thu Jun 16 15:04:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-886657474 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:04:37.509104 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-fe66e6d8-c637-41f0-a344-f7d6223fb2c2 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:37.519112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fe66e6d8-c637-41f0-a344-f7d6223fb2c2 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1676 microversion: 2.1 time: 0.258189 Jun 16 15:04:37.520442 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 451/903] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:37 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1676 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:38.147776 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-772476f9-7f73-4053-9b0c-c8c287a1a0a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:38.148273 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-772476f9-7f73-4053-9b0c-c8c287a1a0a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:38.155035 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-772476f9-7f73-4053-9b0c-c8c287a1a0a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:38.155484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-772476f9-7f73-4053-9b0c-c8c287a1a0a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:38.156513 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-772476f9-7f73-4053-9b0c-c8c287a1a0a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:38.156981 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-772476f9-7f73-4053-9b0c-c8c287a1a0a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:38.246667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-133b27a8-98e8-4daa-9e9b-d174980b6101 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:38.247269 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-133b27a8-98e8-4daa-9e9b-d174980b6101 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:38.253251 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-133b27a8-98e8-4daa-9e9b-d174980b6101 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:38.253706 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-133b27a8-98e8-4daa-9e9b-d174980b6101 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:38.254469 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-133b27a8-98e8-4daa-9e9b-d174980b6101 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:38.255041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-133b27a8-98e8-4daa-9e9b-d174980b6101 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:38.282820 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-772476f9-7f73-4053-9b0c-c8c287a1a0a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lazy-loading 'services' on Instance uuid 133e2287-518a-4c4e-bb51-8790ed7647a7 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:04:38.284921 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-133b27a8-98e8-4daa-9e9b-d174980b6101 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/os-volume_attachments/a1393047-965a-4650-a812-c236458ee943" status: 200 len: 194 microversion: 2.20 time: 0.042718 Jun 16 15:04:38.285519 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 452/904] 10.222.0.72 () {60 vars in 1453 bytes} [Thu Jun 16 15:04:38 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/os-volume_attachments/a1393047-965a-4650-a812-c236458ee943 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 15:04:38.350056 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-918f09aa-db21-4cf6-9c21-f18f908ddc00 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:38.350689 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-918f09aa-db21-4cf6-9c21-f18f908ddc00 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:38.357872 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-918f09aa-db21-4cf6-9c21-f18f908ddc00 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:38.358330 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-918f09aa-db21-4cf6-9c21-f18f908ddc00 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:38.359140 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-918f09aa-db21-4cf6-9c21-f18f908ddc00 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:38.359618 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-918f09aa-db21-4cf6-9c21-f18f908ddc00 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:38.403487 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-772476f9-7f73-4053-9b0c-c8c287a1a0a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "DELETE /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7/os-volume_attachments/f6e8f3dc-47cf-43ad-a5a1-136b787019ea" status: 202 len: 0 microversion: 2.1 time: 0.257017 Jun 16 15:04:38.403487 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 453/905] 10.222.0.72 () {58 vars in 1415 bytes} [Thu Jun 16 15:04:38 2022] DELETE /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7/os-volume_attachments/f6e8f3dc-47cf-43ad-a5a1-136b787019ea => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:04:38.412253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-58e6137b-ad98-4622-ab82-6deb9d016ce0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:38.413479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-58e6137b-ad98-4622-ab82-6deb9d016ce0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:38.420235 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-58e6137b-ad98-4622-ab82-6deb9d016ce0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:38.420688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-58e6137b-ad98-4622-ab82-6deb9d016ce0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:38.421494 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-58e6137b-ad98-4622-ab82-6deb9d016ce0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:38.421939 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-58e6137b-ad98-4622-ab82-6deb9d016ce0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:38.450331 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-918f09aa-db21-4cf6-9c21-f18f908ddc00 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lazy-loading 'services' on Instance uuid 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:04:38.458542 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-58e6137b-ad98-4622-ab82-6deb9d016ce0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050468 Jun 16 15:04:38.459613 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 454/906] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:04:38 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:04:38.527987 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-918f09aa-db21-4cf6-9c21-f18f908ddc00 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "DELETE /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/os-volume_attachments/a1393047-965a-4650-a812-c236458ee943" status: 202 len: 0 microversion: 2.20 time: 0.183267 Jun 16 15:04:38.528707 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 453/907] 10.222.0.72 () {60 vars in 1456 bytes} [Thu Jun 16 15:04:38 2022] DELETE /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/os-volume_attachments/a1393047-965a-4650-a812-c236458ee943 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 15:04:38.538018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e78d8f2b-010b-43d3-8f62-cfe975d235ab tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:38.538989 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e78d8f2b-010b-43d3-8f62-cfe975d235ab tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:38.547124 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e78d8f2b-010b-43d3-8f62-cfe975d235ab tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:38.547356 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1fe579bc-167c-4ab5-af3a-975defbccd7b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:38.547571 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e78d8f2b-010b-43d3-8f62-cfe975d235ab tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:38.547935 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1fe579bc-167c-4ab5-af3a-975defbccd7b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:38.549001 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e78d8f2b-010b-43d3-8f62-cfe975d235ab tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:38.549721 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e78d8f2b-010b-43d3-8f62-cfe975d235ab tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:38.557343 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fe579bc-167c-4ab5-af3a-975defbccd7b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:38.557825 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fe579bc-167c-4ab5-af3a-975defbccd7b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:38.558609 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fe579bc-167c-4ab5-af3a-975defbccd7b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:38.559051 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fe579bc-167c-4ab5-af3a-975defbccd7b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:38.582469 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e78d8f2b-010b-43d3-8f62-cfe975d235ab tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048763 Jun 16 15:04:38.583035 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 455/908] 10.222.0.72 () {60 vars in 1342 bytes} [Thu Jun 16 15:04:38 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 15:04:38.689324 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1fe579bc-167c-4ab5-af3a-975defbccd7b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:38.696825 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1fe579bc-167c-4ab5-af3a-975defbccd7b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1676 microversion: 2.1 time: 0.153868 Jun 16 15:04:38.697407 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 454/909] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:38 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:39.470186 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a14b21a1-65a4-452b-87b0-2721c0d66bf9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:39.471008 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a14b21a1-65a4-452b-87b0-2721c0d66bf9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:39.477418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a14b21a1-65a4-452b-87b0-2721c0d66bf9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:39.477859 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a14b21a1-65a4-452b-87b0-2721c0d66bf9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:39.478600 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a14b21a1-65a4-452b-87b0-2721c0d66bf9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:39.479026 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a14b21a1-65a4-452b-87b0-2721c0d66bf9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:39.507879 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a14b21a1-65a4-452b-87b0-2721c0d66bf9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041655 Jun 16 15:04:39.509166 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 456/910] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:04:39 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:39.593939 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1819fc25-fb57-46e3-af4a-abcbf79048ae tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:39.595044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1819fc25-fb57-46e3-af4a-abcbf79048ae tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:39.601843 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1819fc25-fb57-46e3-af4a-abcbf79048ae tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:39.602942 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1819fc25-fb57-46e3-af4a-abcbf79048ae tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:39.603715 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1819fc25-fb57-46e3-af4a-abcbf79048ae tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:39.604157 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1819fc25-fb57-46e3-af4a-abcbf79048ae tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:39.635201 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1819fc25-fb57-46e3-af4a-abcbf79048ae tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045161 Jun 16 15:04:39.635770 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 455/911] 10.222.0.72 () {60 vars in 1342 bytes} [Thu Jun 16 15:04:39 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 15:04:39.713870 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2058cdd6-c547-4133-a001-cc45b3b87d57 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:39.714470 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2058cdd6-c547-4133-a001-cc45b3b87d57 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:39.720531 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2058cdd6-c547-4133-a001-cc45b3b87d57 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:39.720967 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2058cdd6-c547-4133-a001-cc45b3b87d57 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:39.721728 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2058cdd6-c547-4133-a001-cc45b3b87d57 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:39.722164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2058cdd6-c547-4133-a001-cc45b3b87d57 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:39.852073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2058cdd6-c547-4133-a001-cc45b3b87d57 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:39.859936 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2058cdd6-c547-4133-a001-cc45b3b87d57 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1676 microversion: 2.1 time: 0.149907 Jun 16 15:04:39.860479 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 457/912] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:39 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:40.519885 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5f48a308-7e49-4b28-9167-ff20206480ab tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:40.520715 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5f48a308-7e49-4b28-9167-ff20206480ab tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:40.526827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f48a308-7e49-4b28-9167-ff20206480ab tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:40.527311 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f48a308-7e49-4b28-9167-ff20206480ab tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:40.528065 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f48a308-7e49-4b28-9167-ff20206480ab tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:40.528506 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f48a308-7e49-4b28-9167-ff20206480ab tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:40.547225 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:40.562184 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5f48a308-7e49-4b28-9167-ff20206480ab tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045322 Jun 16 15:04:40.562184 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 456/913] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:04:40 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 15:04:40.620959 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ea3c106a-d319-4e2a-b6cd-bd5131752e48 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:40.621513 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ea3c106a-d319-4e2a-b6cd-bd5131752e48 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:40.627994 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ea3c106a-d319-4e2a-b6cd-bd5131752e48 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:40.628466 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ea3c106a-d319-4e2a-b6cd-bd5131752e48 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:40.629270 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ea3c106a-d319-4e2a-b6cd-bd5131752e48 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:40.629710 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ea3c106a-d319-4e2a-b6cd-bd5131752e48 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:40.647924 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-03e6d6b4-179a-4605-abc8-9457e7a06e12 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:40.650582 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-03e6d6b4-179a-4605-abc8-9457e7a06e12 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:40.657996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03e6d6b4-179a-4605-abc8-9457e7a06e12 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:40.658285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ea3c106a-d319-4e2a-b6cd-bd5131752e48 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:04:40.658937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03e6d6b4-179a-4605-abc8-9457e7a06e12 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:40.660338 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03e6d6b4-179a-4605-abc8-9457e7a06e12 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:40.661362 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03e6d6b4-179a-4605-abc8-9457e7a06e12 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:40.699514 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-03e6d6b4-179a-4605-abc8-9457e7a06e12 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056634 Jun 16 15:04:40.699990 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 457/914] 10.222.0.72 () {60 vars in 1342 bytes} [Thu Jun 16 15:04:40 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:40.742329 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ea3c106a-d319-4e2a-b6cd-bd5131752e48 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "DELETE /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 204 len: 0 microversion: 2.1 time: 0.125535 Jun 16 15:04:40.744918 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 458/915] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:04:40 2022] DELETE /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:04:40.752227 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-14254444-f969-4f08-87d0-432d63f751e9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:40.752909 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-14254444-f969-4f08-87d0-432d63f751e9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:40.759285 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-14254444-f969-4f08-87d0-432d63f751e9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:40.759797 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-14254444-f969-4f08-87d0-432d63f751e9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:40.760568 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-14254444-f969-4f08-87d0-432d63f751e9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:40.761232 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-14254444-f969-4f08-87d0-432d63f751e9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:40.762635 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5cd2dfb6-f7d7-49b9-b995-5bd5580d92e3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:40.763272 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5cd2dfb6-f7d7-49b9-b995-5bd5580d92e3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:40.769356 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5cd2dfb6-f7d7-49b9-b995-5bd5580d92e3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:40.769809 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5cd2dfb6-f7d7-49b9-b995-5bd5580d92e3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:40.770634 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5cd2dfb6-f7d7-49b9-b995-5bd5580d92e3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:40.771017 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5cd2dfb6-f7d7-49b9-b995-5bd5580d92e3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:40.799093 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5cd2dfb6-f7d7-49b9-b995-5bd5580d92e3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:04:40.877977 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5cd2dfb6-f7d7-49b9-b995-5bd5580d92e3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "DELETE /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 204 len: 0 microversion: 2.20 time: 0.119473 Jun 16 15:04:40.878802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 459/916] 10.222.0.72 () {60 vars in 1279 bytes} [Thu Jun 16 15:04:40 2022] DELETE /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 15:04:40.888552 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-187133ff-1b39-4823-b35b-d2089605a9a1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:40.889277 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-187133ff-1b39-4823-b35b-d2089605a9a1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:40.895381 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-187133ff-1b39-4823-b35b-d2089605a9a1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:40.895833 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-187133ff-1b39-4823-b35b-d2089605a9a1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:40.896600 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-187133ff-1b39-4823-b35b-d2089605a9a1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:40.897075 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-187133ff-1b39-4823-b35b-d2089605a9a1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:40.903826 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-14254444-f969-4f08-87d0-432d63f751e9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:40.911735 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-14254444-f969-4f08-87d0-432d63f751e9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1683 microversion: 2.1 time: 0.163452 Jun 16 15:04:40.912294 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 458/917] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:40 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:40.917305 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-787feee9-2fb1-4eaf-a75e-bab76d4607ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:40.918168 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-787feee9-2fb1-4eaf-a75e-bab76d4607ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:40.924427 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-787feee9-2fb1-4eaf-a75e-bab76d4607ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:40.924909 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-787feee9-2fb1-4eaf-a75e-bab76d4607ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:40.925673 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-787feee9-2fb1-4eaf-a75e-bab76d4607ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:40.926111 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-787feee9-2fb1-4eaf-a75e-bab76d4607ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:41.033770 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-187133ff-1b39-4823-b35b-d2089605a9a1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:41.042023 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-187133ff-1b39-4823-b35b-d2089605a9a1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1676 microversion: 2.1 time: 0.158917 Jun 16 15:04:41.042591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 460/918] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:40 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:41.058792 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-787feee9-2fb1-4eaf-a75e-bab76d4607ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:41.066742 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-787feee9-2fb1-4eaf-a75e-bab76d4607ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:41.068236 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-787feee9-2fb1-4eaf-a75e-bab76d4607ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:41.069497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-787feee9-2fb1-4eaf-a75e-bab76d4607ec tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.156292 Jun 16 15:04:41.070042 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 459/919] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:04:40 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:04:41.929720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1dc09726-35c3-4af7-a607-c3161d022e29 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:41.930317 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1dc09726-35c3-4af7-a607-c3161d022e29 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:41.936939 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1dc09726-35c3-4af7-a607-c3161d022e29 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:41.937582 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1dc09726-35c3-4af7-a607-c3161d022e29 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:41.938120 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1dc09726-35c3-4af7-a607-c3161d022e29 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:41.938557 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1dc09726-35c3-4af7-a607-c3161d022e29 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:42.059336 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c8f0e181-f259-4446-8528-fb52d667d096 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:42.060046 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c8f0e181-f259-4446-8528-fb52d667d096 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:42.067812 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8f0e181-f259-4446-8528-fb52d667d096 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:42.068274 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8f0e181-f259-4446-8528-fb52d667d096 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:42.069106 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8f0e181-f259-4446-8528-fb52d667d096 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:42.069552 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8f0e181-f259-4446-8528-fb52d667d096 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:42.233085 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c8f0e181-f259-4446-8528-fb52d667d096 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:42.240861 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c8f0e181-f259-4446-8528-fb52d667d096 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1676 microversion: 2.1 time: 0.185429 Jun 16 15:04:42.250410 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 460/920] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:42 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:42.250410 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e945dd66-3414-4950-af1a-0890f60fc08e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:42.250410 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e945dd66-3414-4950-af1a-0890f60fc08e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:42.253486 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e945dd66-3414-4950-af1a-0890f60fc08e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:42.254247 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e945dd66-3414-4950-af1a-0890f60fc08e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:42.255010 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e945dd66-3414-4950-af1a-0890f60fc08e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:42.255453 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e945dd66-3414-4950-af1a-0890f60fc08e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:42.317208 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1dc09726-35c3-4af7-a607-c3161d022e29 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:42.331417 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1dc09726-35c3-4af7-a607-c3161d022e29 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1683 microversion: 2.1 time: 0.405121 Jun 16 15:04:42.332695 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 461/921] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:41 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1683 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:42.395331 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e945dd66-3414-4950-af1a-0890f60fc08e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:42.403273 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e945dd66-3414-4950-af1a-0890f60fc08e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:42.404745 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e945dd66-3414-4950-af1a-0890f60fc08e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:42.406175 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e945dd66-3414-4950-af1a-0890f60fc08e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.163571 Jun 16 15:04:42.406724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 461/922] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:04:42 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:04:43.258029 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b613e17e-d9d9-4fd7-abc4-b5e14abfd41e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:43.258630 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b613e17e-d9d9-4fd7-abc4-b5e14abfd41e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:43.265320 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b613e17e-d9d9-4fd7-abc4-b5e14abfd41e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:43.265765 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b613e17e-d9d9-4fd7-abc4-b5e14abfd41e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:43.266514 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b613e17e-d9d9-4fd7-abc4-b5e14abfd41e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:43.267040 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b613e17e-d9d9-4fd7-abc4-b5e14abfd41e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:43.358574 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a8e909ef-d579-462d-a4bf-4f473e89a07a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:43.359189 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a8e909ef-d579-462d-a4bf-4f473e89a07a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:43.365807 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8e909ef-d579-462d-a4bf-4f473e89a07a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:43.366254 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8e909ef-d579-462d-a4bf-4f473e89a07a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:43.367015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8e909ef-d579-462d-a4bf-4f473e89a07a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:43.367446 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8e909ef-d579-462d-a4bf-4f473e89a07a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:43.402362 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b613e17e-d9d9-4fd7-abc4-b5e14abfd41e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:43.410354 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b613e17e-d9d9-4fd7-abc4-b5e14abfd41e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1676 microversion: 2.1 time: 0.156145 Jun 16 15:04:43.410987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 462/923] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:43 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:43.423640 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f2887325-1d68-4cae-b9b2-a483435ee2b6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:43.424306 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f2887325-1d68-4cae-b9b2-a483435ee2b6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:43.430472 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f2887325-1d68-4cae-b9b2-a483435ee2b6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:43.430924 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f2887325-1d68-4cae-b9b2-a483435ee2b6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:43.431693 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f2887325-1d68-4cae-b9b2-a483435ee2b6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:43.432133 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f2887325-1d68-4cae-b9b2-a483435ee2b6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:43.517855 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a8e909ef-d579-462d-a4bf-4f473e89a07a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:43.526180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a8e909ef-d579-462d-a4bf-4f473e89a07a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1683 microversion: 2.1 time: 0.171307 Jun 16 15:04:43.526767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 462/924] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:43 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:43.567420 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f2887325-1d68-4cae-b9b2-a483435ee2b6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:43.575990 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f2887325-1d68-4cae-b9b2-a483435ee2b6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:43.577521 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f2887325-1d68-4cae-b9b2-a483435ee2b6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:43.578664 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f2887325-1d68-4cae-b9b2-a483435ee2b6 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.159026 Jun 16 15:04:43.579205 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 463/925] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:04:43 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:04:44.427211 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-861867cd-8ecb-4585-8e9a-275831bc1355 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:44.427827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-861867cd-8ecb-4585-8e9a-275831bc1355 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:44.435272 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-861867cd-8ecb-4585-8e9a-275831bc1355 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:44.435773 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-861867cd-8ecb-4585-8e9a-275831bc1355 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:44.436460 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-861867cd-8ecb-4585-8e9a-275831bc1355 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:44.436926 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-861867cd-8ecb-4585-8e9a-275831bc1355 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:44.544099 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-02da0749-f643-45bf-b58b-ac984ebbf4a9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:44.544697 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-02da0749-f643-45bf-b58b-ac984ebbf4a9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:44.551500 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-02da0749-f643-45bf-b58b-ac984ebbf4a9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:44.551951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-02da0749-f643-45bf-b58b-ac984ebbf4a9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:44.552730 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-02da0749-f643-45bf-b58b-ac984ebbf4a9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:44.553192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-02da0749-f643-45bf-b58b-ac984ebbf4a9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:44.618597 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-02da0749-f643-45bf-b58b-ac984ebbf4a9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:44.622258 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:44.627863 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-02da0749-f643-45bf-b58b-ac984ebbf4a9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1615 microversion: 2.1 time: 0.088105 Jun 16 15:04:44.628450 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 464/926] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:44 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1615 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:44.633438 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c4dacc06-722e-4976-9202-a977197851de tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:44.634153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c4dacc06-722e-4976-9202-a977197851de tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:44.641668 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c4dacc06-722e-4976-9202-a977197851de tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:44.642117 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c4dacc06-722e-4976-9202-a977197851de tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:44.642900 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c4dacc06-722e-4976-9202-a977197851de tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:44.643337 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c4dacc06-722e-4976-9202-a977197851de tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:44.784741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c4dacc06-722e-4976-9202-a977197851de tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:44.793980 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c4dacc06-722e-4976-9202-a977197851de tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:44.795444 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c4dacc06-722e-4976-9202-a977197851de tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:44.796594 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c4dacc06-722e-4976-9202-a977197851de tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1724 microversion: 2.20 time: 0.167196 Jun 16 15:04:44.797176 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 465/927] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:04:44 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:04:45.048327 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-861867cd-8ecb-4585-8e9a-275831bc1355 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:45.057443 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-861867cd-8ecb-4585-8e9a-275831bc1355 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1676 microversion: 2.1 time: 0.633948 Jun 16 15:04:45.058036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 463/928] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:44 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1676 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:45.367294 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-0acd480e-16aa-46c1-a19b-02034599177f req-f8413d6c-fd0f-4a99-bbdd-a41b3867516a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "133e2287-518a-4c4e-bb51-8790ed7647a7", "name": "network-vif-deleted", "tag": "ea6268ec-2917-4b9f-ac8d-bc4237b637d9"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:45.382277 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-0acd480e-16aa-46c1-a19b-02034599177f req-f8413d6c-fd0f-4a99-bbdd-a41b3867516a service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:45.382679 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-0acd480e-16aa-46c1-a19b-02034599177f req-f8413d6c-fd0f-4a99-bbdd-a41b3867516a service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:45.400560 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-0acd480e-16aa-46c1-a19b-02034599177f req-f8413d6c-fd0f-4a99-bbdd-a41b3867516a service nova] Creating event network-vif-deleted:ea6268ec-2917-4b9f-ac8d-bc4237b637d9 for instance 133e2287-518a-4c4e-bb51-8790ed7647a7 on hv-cinder-83716 Jun 16 15:04:45.412825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-0acd480e-16aa-46c1-a19b-02034599177f req-f8413d6c-fd0f-4a99-bbdd-a41b3867516a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049847 Jun 16 15:04:45.414146 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 466/929] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:45.645514 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ef45dc21-2746-4d85-844c-107519560d4e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:45.646870 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ef45dc21-2746-4d85-844c-107519560d4e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:45.653378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ef45dc21-2746-4d85-844c-107519560d4e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:45.653832 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ef45dc21-2746-4d85-844c-107519560d4e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:45.654613 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ef45dc21-2746-4d85-844c-107519560d4e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:45.655048 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ef45dc21-2746-4d85-844c-107519560d4e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:45.687291 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ef45dc21-2746-4d85-844c-107519560d4e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:45.687747 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ef45dc21-2746-4d85-844c-107519560d4e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:45.688203 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-ef45dc21-2746-4d85-844c-107519560d4e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lazy-loading 'fault' on Instance uuid 133e2287-518a-4c4e-bb51-8790ed7647a7 {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:04:45.734495 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ef45dc21-2746-4d85-844c-107519560d4e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:45.743441 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ef45dc21-2746-4d85-844c-107519560d4e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 200 len: 1331 microversion: 2.1 time: 0.100872 Jun 16 15:04:45.744225 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 464/930] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:45 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:45.814991 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e9f7a248-9c20-4dd8-8ed6-bfcd8e17094f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:45.815683 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e9f7a248-9c20-4dd8-8ed6-bfcd8e17094f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:45.823177 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e9f7a248-9c20-4dd8-8ed6-bfcd8e17094f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:45.823708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e9f7a248-9c20-4dd8-8ed6-bfcd8e17094f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:45.824645 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e9f7a248-9c20-4dd8-8ed6-bfcd8e17094f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:45.825114 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e9f7a248-9c20-4dd8-8ed6-bfcd8e17094f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:45.857513 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e9f7a248-9c20-4dd8-8ed6-bfcd8e17094f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:45.858242 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e9f7a248-9c20-4dd8-8ed6-bfcd8e17094f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:45.858840 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-e9f7a248-9c20-4dd8-8ed6-bfcd8e17094f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lazy-loading 'fault' on Instance uuid 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:04:45.912640 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e9f7a248-9c20-4dd8-8ed6-bfcd8e17094f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:45.931999 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e9f7a248-9c20-4dd8-8ed6-bfcd8e17094f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:45.933892 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e9f7a248-9c20-4dd8-8ed6-bfcd8e17094f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:45.935086 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e9f7a248-9c20-4dd8-8ed6-bfcd8e17094f tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 200 len: 1371 microversion: 2.20 time: 0.124431 Jun 16 15:04:45.935955 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 467/931] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:04:45 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 1371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:04:46.077081 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-784bab4c-65e6-40eb-85c1-19d9c5da7ccd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:46.078673 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-784bab4c-65e6-40eb-85c1-19d9c5da7ccd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:46.085548 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-784bab4c-65e6-40eb-85c1-19d9c5da7ccd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:46.086359 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-784bab4c-65e6-40eb-85c1-19d9c5da7ccd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:46.087786 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-784bab4c-65e6-40eb-85c1-19d9c5da7ccd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:46.088556 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-784bab4c-65e6-40eb-85c1-19d9c5da7ccd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:46.272702 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-784bab4c-65e6-40eb-85c1-19d9c5da7ccd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:46.283541 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-784bab4c-65e6-40eb-85c1-19d9c5da7ccd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1676 microversion: 2.1 time: 0.212467 Jun 16 15:04:46.286203 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 465/932] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:46 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1676 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:46.761293 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d3fd140f-473e-4ffb-bf8f-22d18cea5fb2 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:46.761899 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d3fd140f-473e-4ffb-bf8f-22d18cea5fb2 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:46.767997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d3fd140f-473e-4ffb-bf8f-22d18cea5fb2 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:46.768451 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d3fd140f-473e-4ffb-bf8f-22d18cea5fb2 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:46.769286 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d3fd140f-473e-4ffb-bf8f-22d18cea5fb2 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:46.769723 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d3fd140f-473e-4ffb-bf8f-22d18cea5fb2 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:46.784150 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-d3fd140f-473e-4ffb-bf8f-22d18cea5fb2 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] HTTP exception thrown: Instance 133e2287-518a-4c4e-bb51-8790ed7647a7 could not be found. Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d3fd140f-473e-4ffb-bf8f-22d18cea5fb2 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Request method failure captured: Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 HTTP/1.1 Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0TU2Gjo7bUkrQIinrAEmUizdcavVo4cOx7_e9CBdhqQMOL_HN88fbcSkNjz0fxmjx2YzvDmjFBGY4yiPbtaUHC4qF4lZPrXQHcA8kaogkzbM_Pr4t5ixnvBhbj3OMnQtdL4-hEGTH3GzOC14o5hpUT2K4iK3ilxCwb3lslIqMZDzIU Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 15:04:46.786038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 15:04:46.787592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2940b81a86c2401db1aa432d9a0735eb", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:04:46.787592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:04:46.787592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:04:46.787592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:04:46.787592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:04:46.787592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 15:04:46.787592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 15:04:46.787592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: 0b8be0ab53ae48af844bc281dee5f77c Jun 16 15:04:46.787592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:04:46.787592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 15:04:46.787592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance 133e2287-518a-4c4e-bb51-8790ed7647a7 could not be found. Jun 16 15:04:46.787592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': '133e2287-518a-4c4e-bb51-8790ed7647a7'} Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 133e2287-518a-4c4e-bb51-8790ed7647a7 could not be found. Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:04:46.788436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:04:46.790015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:04:46.790015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:04:46.790015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:04:46.790015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:04:46.790015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:04:46.790015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:04:46.790015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:04:46.790015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 133e2287-518a-4c4e-bb51-8790ed7647a7 could not be found. Jun 16 15:04:46.790015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:46.790015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:04:46.790015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:46.790015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:46.790015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:04:46.790015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:04:46.790015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:04:46.790015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:04:46.790015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 133e2287-518a-4c4e-bb51-8790ed7647a7 could not be found. Jun 16 15:04:46.790015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:46.791311 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d3fd140f-473e-4ffb-bf8f-22d18cea5fb2 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Returning 404 to user: Instance 133e2287-518a-4c4e-bb51-8790ed7647a7 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:04:46.791311 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d3fd140f-473e-4ffb-bf8f-22d18cea5fb2 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 404 len: 111 microversion: 2.1 time: 0.030539 Jun 16 15:04:46.791311 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 468/933] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:46 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:04:46.796391 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-94cc8ba0-2f07-47b0-88f7-1e3781d49e9c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '.version_select at 0x7faab62ae280>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:46.817074 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-94cc8ba0-2f07-47b0-88f7-1e3781d49e9c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473530072" status: 202 len: 0 microversion: 2.1 time: 0.024250 Jun 16 15:04:46.817645 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 466/934] 10.222.0.72 () {58 vars in 1220 bytes} [Thu Jun 16 15:04:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1473530072 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:04:46.953552 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2bf1db99-15f3-4688-a80d-f334b974a45d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:46.954254 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2bf1db99-15f3-4688-a80d-f334b974a45d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:46.960890 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2bf1db99-15f3-4688-a80d-f334b974a45d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:46.961351 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2bf1db99-15f3-4688-a80d-f334b974a45d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:46.962137 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2bf1db99-15f3-4688-a80d-f334b974a45d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:46.962590 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2bf1db99-15f3-4688-a80d-f334b974a45d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:46.978086 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-2bf1db99-15f3-4688-a80d-f334b974a45d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] HTTP exception thrown: Instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 could not be found. Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2bf1db99-15f3-4688-a80d-f334b974a45d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Request method failure captured: Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 HTTP/1.1 Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0TMjpgChMWBltqPqlOc2QLsqFboHlFg7Zhv6oU8m-3VLra0wCtdBtTj_z-1OqG7sk_8iOEaxtlGIalQr-G6Bz9vT5IwYPuKye4Llr6wMS6vkPTzMQ4Dq1iDN_uiO6bNTWhTo8q3fke8bdPNcKKH6s83IDG0IfsBVY-RvsFLarne2Lc Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 2a4c67a42f8a405d84d4697a45e962ff Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1860873197 Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 15:04:46.979383 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 15:04:46.981118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2a4c67a42f8a405d84d4697a45e962ff", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a4c67a42f8a405d84d4697a45e962ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a4c67a42f8a405d84d4697a45e962ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2a4c67a42f8a405d84d4697a45e962ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:04:46.981118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1860873197 Jun 16 15:04:46.981118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 2a4c67a42f8a405d84d4697a45e962ff Jun 16 15:04:46.981118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1860873197 Jun 16 15:04:46.981118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeShelveTestJSON-1860873197-project Jun 16 15:04:46.981118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 15:04:46.981118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 15:04:46.981118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: ba40bcf173404e6c8b17d311b65bf780 Jun 16 15:04:46.981118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1860873197-project Jun 16 15:04:46.981118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 15:04:46.981118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 could not be found. Jun 16 15:04:46.981118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': '895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9'} Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 could not be found. Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:04:46.981987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:04:46.983441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:04:46.983441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:04:46.983441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:04:46.983441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:04:46.983441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:04:46.983441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:04:46.983441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:04:46.983441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 could not be found. Jun 16 15:04:46.983441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:46.983441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:04:46.983441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:46.983441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:04:46.983441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:04:46.983441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:04:46.983441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:04:46.983441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:04:46.983441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 could not be found. Jun 16 15:04:46.983441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:04:46.984997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2bf1db99-15f3-4688-a80d-f334b974a45d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Returning 404 to user: Instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:04:46.984997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2bf1db99-15f3-4688-a80d-f334b974a45d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 404 len: 111 microversion: 2.20 time: 0.031460 Jun 16 15:04:46.984997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 469/935] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:04:46 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 15:04:47.001146 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6f22c444-3a3f-4e57-8871-ec7227e03f92 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '.version_select at 0x7faab6427700>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:47.020734 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6f22c444-3a3f-4e57-8871-ec7227e03f92 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006749574" status: 204 len: 0 microversion: 2.20 time: 0.034403 Jun 16 15:04:47.021345 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 467/936] 10.222.0.72 () {60 vars in 1261 bytes} [Thu Jun 16 15:04:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006749574 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 15:04:47.301696 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-34723267-4520-454f-bbea-399bb57589f0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:47.302304 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-34723267-4520-454f-bbea-399bb57589f0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:47.309369 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-34723267-4520-454f-bbea-399bb57589f0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:47.309817 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-34723267-4520-454f-bbea-399bb57589f0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:47.311135 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-34723267-4520-454f-bbea-399bb57589f0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:47.311727 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-34723267-4520-454f-bbea-399bb57589f0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:47.462729 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-41e457fc-6e10-4a35-9ba0-89fed7ec856f req-608b7c08-0f63-4721-85de-b9dce00c39f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9", "name": "network-vif-deleted", "tag": "4a15d94a-43cc-45b4-89d5-3b8cdc6c8c65"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:47.471482 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-41e457fc-6e10-4a35-9ba0-89fed7ec856f req-608b7c08-0f63-4721-85de-b9dce00c39f4 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:47.472160 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-41e457fc-6e10-4a35-9ba0-89fed7ec856f req-608b7c08-0f63-4721-85de-b9dce00c39f4 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:47.484443 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-41e457fc-6e10-4a35-9ba0-89fed7ec856f req-608b7c08-0f63-4721-85de-b9dce00c39f4 service nova] Creating event network-vif-deleted:4a15d94a-43cc-45b4-89d5-3b8cdc6c8c65 for instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 on hv-cinder-83716 Jun 16 15:04:47.489512 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-41e457fc-6e10-4a35-9ba0-89fed7ec856f req-608b7c08-0f63-4721-85de-b9dce00c39f4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031630 Jun 16 15:04:47.490256 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 468/937] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:47.532294 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-34723267-4520-454f-bbea-399bb57589f0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:47.539875 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-34723267-4520-454f-bbea-399bb57589f0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1676 microversion: 2.1 time: 0.241413 Jun 16 15:04:47.540446 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 470/938] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:47 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:47.540801 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fbd4644b-2e30-4931-9359-d447335c64f3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Action: 'create', calling method: .version_select at 0x7faab62570d0>, body: {"keypair": {"name": "tempest-keypair-340238400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBZPdr7xxdUci1ornIcgfLEx5xci7F3iglILIoPIH8jA914Oucmwjo3Uh4RoC4uLnTL8qFddcdBoeygrvu+LamGLGWol3HjfBw1ZJRkxBrC3EzcfF5mmAG6bCzAd+xRoJQ=="}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:47.557641 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-fbd4644b-2e30-4931-9359-d447335c64f3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Getting quotas for project 2940b81a86c2401db1aa432d9a0735eb. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:04:47.561560 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-fbd4644b-2e30-4931-9359-d447335c64f3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Getting quotas for user 0b8be0ab53ae48af844bc281dee5f77c and project 2940b81a86c2401db1aa432d9a0735eb. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:04:47.584629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fbd4644b-2e30-4931-9359-d447335c64f3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050110 Jun 16 15:04:47.585294 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 469/939] 10.222.0.72 () {60 vars in 1158 bytes} [Thu Jun 16 15:04:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:47.702308 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-04930dc3-3002-4ad0-80a9-466079e8ea20 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Action: 'create', calling method: .version_select at 0x7faaba97f550>, body: {"keypair": {"name": "tempest-keypair-996339506", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7omDmO3O8wSZbDKvSQQ7VB2fPxYW17BhurY6yZ7N0AVkvI0vI/APdJX5/xJRPtoVef5msMIScW0NXIh+l32N0xvw/5L7r89GiGuMxQtcakJJUriAq6+a1k4EXAcFMZ9Q=="}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:47.717180 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-04930dc3-3002-4ad0-80a9-466079e8ea20 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Getting quotas for project 2a4c67a42f8a405d84d4697a45e962ff. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:04:47.721958 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-04930dc3-3002-4ad0-80a9-466079e8ea20 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Getting quotas for user ba40bcf173404e6c8b17d311b65bf780 and project 2a4c67a42f8a405d84d4697a45e962ff. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:04:47.723679 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:47.758936 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-04930dc3-3002-4ad0-80a9-466079e8ea20 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.060871 Jun 16 15:04:47.759757 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 471/940] 10.222.0.72 () {62 vars in 1199 bytes} [Thu Jun 16 15:04:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 15:04:48.557637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-228bdfef-1f32-4608-a74c-9ccb50d3e026 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:48.558449 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-228bdfef-1f32-4608-a74c-9ccb50d3e026 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:48.565637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-228bdfef-1f32-4608-a74c-9ccb50d3e026 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:48.566395 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-228bdfef-1f32-4608-a74c-9ccb50d3e026 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:48.567242 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-228bdfef-1f32-4608-a74c-9ccb50d3e026 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:48.567742 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-228bdfef-1f32-4608-a74c-9ccb50d3e026 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:48.773051 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-228bdfef-1f32-4608-a74c-9ccb50d3e026 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:48.781894 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-228bdfef-1f32-4608-a74c-9ccb50d3e026 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1676 microversion: 2.1 time: 0.229129 Jun 16 15:04:48.782727 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 470/941] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:48 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1676 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:48.911798 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c1123058-2e12-4f47-a3c9-e1fa19a3eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-857529807", "imageRef": "23371504-a4d6-4064-90b4-87bfd0a15170", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "585283c3-d940-441f-ba61-bbe0dfecbee8"}], "security_groups": [{"name": "tempest-securitygroup--1542244541"}], "key_name": "tempest-keypair-340238400", "user_data": "}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:49.019309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.network.neutron [None req-c1123058-2e12-4f47-a3c9-e1fa19a3eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] validate_networks() for [('585283c3-d940-441f-ba61-bbe0dfecbee8', None, None, None, None, None)] {{(pid=124589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:04:49.295294 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0679a356-5e17-44e5-a63f-b61ad70ee883 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-401439062", "imageRef": "23371504-a4d6-4064-90b4-87bfd0a15170", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3dc2fbd7-b902-4092-9a0a-ec11d0484649"}], "security_groups": [{"name": "tempest-securitygroup--909915726"}], "key_name": "tempest-keypair-996339506", "user_data": "}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:49.402886 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-0679a356-5e17-44e5-a63f-b61ad70ee883 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] validate_networks() for [('3dc2fbd7-b902-4092-9a0a-ec11d0484649', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:04:49.423097 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-c1123058-2e12-4f47-a3c9-e1fa19a3eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Flavor limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:04:49.423526 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-c1123058-2e12-4f47-a3c9-e1fa19a3eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Image limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:04:49.424000 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-c1123058-2e12-4f47-a3c9-e1fa19a3eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Flavor pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:04:49.424472 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-c1123058-2e12-4f47-a3c9-e1fa19a3eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Image pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:04:49.424926 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-c1123058-2e12-4f47-a3c9-e1fa19a3eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:04:49.434484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c1123058-2e12-4f47-a3c9-e1fa19a3eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:49.434965 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c1123058-2e12-4f47-a3c9-e1fa19a3eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:49.435890 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c1123058-2e12-4f47-a3c9-e1fa19a3eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:49.436229 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c1123058-2e12-4f47-a3c9-e1fa19a3eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:49.454496 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-c1123058-2e12-4f47-a3c9-e1fa19a3eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Getting quotas for project 2940b81a86c2401db1aa432d9a0735eb. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:04:49.458487 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-c1123058-2e12-4f47-a3c9-e1fa19a3eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Getting quotas for user 0b8be0ab53ae48af844bc281dee5f77c and project 2940b81a86c2401db1aa432d9a0735eb. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:04:49.469494 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c1123058-2e12-4f47-a3c9-e1fa19a3eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Going to run 1 instances... {{(pid=124589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:04:49.471765 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c1123058-2e12-4f47-a3c9-e1fa19a3eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23371504-a4d6-4064-90b4-87bfd0a15170',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:04:49.520874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c1123058-2e12-4f47-a3c9-e1fa19a3eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.613851 Jun 16 15:04:49.522001 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 472/942] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 15:04:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 15:04:49.532151 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-668668af-5134-4aa1-8b6a-94b0555d0256 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:49.532696 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-668668af-5134-4aa1-8b6a-94b0555d0256 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:49.590113 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-668668af-5134-4aa1-8b6a-94b0555d0256 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:49.597103 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-668668af-5134-4aa1-8b6a-94b0555d0256 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1240 microversion: 2.1 time: 0.069103 Jun 16 15:04:49.597676 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 473/943] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:49 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:49.799740 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0eee07cc-d0de-42bd-9e9e-5b812d8c96b1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:49.800541 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0eee07cc-d0de-42bd-9e9e-5b812d8c96b1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:49.806631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-0679a356-5e17-44e5-a63f-b61ad70ee883 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:04:49.807243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-0679a356-5e17-44e5-a63f-b61ad70ee883 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:04:49.809683 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-0679a356-5e17-44e5-a63f-b61ad70ee883 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:04:49.811315 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0eee07cc-d0de-42bd-9e9e-5b812d8c96b1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:49.811835 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0eee07cc-d0de-42bd-9e9e-5b812d8c96b1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:49.812323 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-0679a356-5e17-44e5-a63f-b61ad70ee883 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:04:49.813180 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0eee07cc-d0de-42bd-9e9e-5b812d8c96b1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:49.813837 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-0679a356-5e17-44e5-a63f-b61ad70ee883 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:04:49.817320 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0eee07cc-d0de-42bd-9e9e-5b812d8c96b1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:49.827623 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0679a356-5e17-44e5-a63f-b61ad70ee883 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:49.828166 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0679a356-5e17-44e5-a63f-b61ad70ee883 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:49.829226 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0679a356-5e17-44e5-a63f-b61ad70ee883 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:49.829651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0679a356-5e17-44e5-a63f-b61ad70ee883 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:49.847187 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-0679a356-5e17-44e5-a63f-b61ad70ee883 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Getting quotas for project 2a4c67a42f8a405d84d4697a45e962ff. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:04:49.851255 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-0679a356-5e17-44e5-a63f-b61ad70ee883 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Getting quotas for user ba40bcf173404e6c8b17d311b65bf780 and project 2a4c67a42f8a405d84d4697a45e962ff. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:04:49.864052 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0679a356-5e17-44e5-a63f-b61ad70ee883 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:04:49.870364 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0679a356-5e17-44e5-a63f-b61ad70ee883 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23371504-a4d6-4064-90b4-87bfd0a15170',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:04:49.922480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0679a356-5e17-44e5-a63f-b61ad70ee883 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.631505 Jun 16 15:04:49.925001 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 471/944] 10.222.0.72 () {62 vars in 1187 bytes} [Thu Jun 16 15:04:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 15:04:49.933578 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a7c90be0-7f8f-4d3d-9e5a-108e4e84d1bb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:49.934349 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a7c90be0-7f8f-4d3d-9e5a-108e4e84d1bb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:49.974873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0eee07cc-d0de-42bd-9e9e-5b812d8c96b1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:49.983219 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0eee07cc-d0de-42bd-9e9e-5b812d8c96b1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1676 microversion: 2.1 time: 0.187280 Jun 16 15:04:49.983794 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 474/945] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:49 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1676 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:50.007185 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a7c90be0-7f8f-4d3d-9e5a-108e4e84d1bb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:50.014996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a7c90be0-7f8f-4d3d-9e5a-108e4e84d1bb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:50.016524 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a7c90be0-7f8f-4d3d-9e5a-108e4e84d1bb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:50.018045 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a7c90be0-7f8f-4d3d-9e5a-108e4e84d1bb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1280 microversion: 2.20 time: 0.088545 Jun 16 15:04:50.019092 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 472/946] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:04:49 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1280 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:04:50.613858 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1ccebf57-3788-4914-abb1-33bb23fe3c22 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:50.614467 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1ccebf57-3788-4914-abb1-33bb23fe3c22 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:50.622227 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1ccebf57-3788-4914-abb1-33bb23fe3c22 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:50.622711 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1ccebf57-3788-4914-abb1-33bb23fe3c22 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:50.623497 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1ccebf57-3788-4914-abb1-33bb23fe3c22 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:50.623986 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1ccebf57-3788-4914-abb1-33bb23fe3c22 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:50.700344 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1ccebf57-3788-4914-abb1-33bb23fe3c22 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:50.707808 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1ccebf57-3788-4914-abb1-33bb23fe3c22 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1292 microversion: 2.1 time: 0.097751 Jun 16 15:04:50.708366 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 475/947] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:50 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1292 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:51.003508 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e4dda11b-2dba-44a4-9a08-f59db6ff8aaa tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:51.004123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e4dda11b-2dba-44a4-9a08-f59db6ff8aaa tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:51.011402 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e4dda11b-2dba-44a4-9a08-f59db6ff8aaa tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:51.011856 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e4dda11b-2dba-44a4-9a08-f59db6ff8aaa tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:51.012655 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e4dda11b-2dba-44a4-9a08-f59db6ff8aaa tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:51.013149 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e4dda11b-2dba-44a4-9a08-f59db6ff8aaa tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:51.037194 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fa2e4fb1-c845-4000-b30c-9a97295c15b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:51.037802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fa2e4fb1-c845-4000-b30c-9a97295c15b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:51.045142 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa2e4fb1-c845-4000-b30c-9a97295c15b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:51.045597 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa2e4fb1-c845-4000-b30c-9a97295c15b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:51.046432 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa2e4fb1-c845-4000-b30c-9a97295c15b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:51.046843 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa2e4fb1-c845-4000-b30c-9a97295c15b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:51.111098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fa2e4fb1-c845-4000-b30c-9a97295c15b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:51.121605 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fa2e4fb1-c845-4000-b30c-9a97295c15b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:51.123338 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fa2e4fb1-c845-4000-b30c-9a97295c15b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:51.124458 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fa2e4fb1-c845-4000-b30c-9a97295c15b7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1332 microversion: 2.20 time: 0.091218 Jun 16 15:04:51.125238 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 476/948] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:04:51 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1332 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:04:51.145246 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e4dda11b-2dba-44a4-9a08-f59db6ff8aaa tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:51.152754 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e4dda11b-2dba-44a4-9a08-f59db6ff8aaa tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1676 microversion: 2.1 time: 0.153150 Jun 16 15:04:51.153345 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 473/949] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:50 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:51.726406 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ed532749-8be9-4e37-bda0-03d37925de3a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:51.727259 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ed532749-8be9-4e37-bda0-03d37925de3a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:51.734014 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed532749-8be9-4e37-bda0-03d37925de3a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:51.734555 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed532749-8be9-4e37-bda0-03d37925de3a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:51.735411 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed532749-8be9-4e37-bda0-03d37925de3a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:51.735920 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed532749-8be9-4e37-bda0-03d37925de3a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:51.801559 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ed532749-8be9-4e37-bda0-03d37925de3a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:51.810075 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ed532749-8be9-4e37-bda0-03d37925de3a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1298 microversion: 2.1 time: 0.088158 Jun 16 15:04:51.810884 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 477/950] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:51 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:52.143591 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5138d42f-2076-47fc-80e8-65a4b76b5339 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:52.145235 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5138d42f-2076-47fc-80e8-65a4b76b5339 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:52.152425 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5138d42f-2076-47fc-80e8-65a4b76b5339 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:52.152994 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5138d42f-2076-47fc-80e8-65a4b76b5339 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:52.153781 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5138d42f-2076-47fc-80e8-65a4b76b5339 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:52.154269 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5138d42f-2076-47fc-80e8-65a4b76b5339 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:52.170508 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-064a3d83-8f68-4a0b-b7e0-006071828fa6 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:52.171790 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-064a3d83-8f68-4a0b-b7e0-006071828fa6 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:52.181454 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-064a3d83-8f68-4a0b-b7e0-006071828fa6 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:52.181914 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-064a3d83-8f68-4a0b-b7e0-006071828fa6 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:52.182700 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-064a3d83-8f68-4a0b-b7e0-006071828fa6 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:52.183139 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-064a3d83-8f68-4a0b-b7e0-006071828fa6 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:52.283995 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5138d42f-2076-47fc-80e8-65a4b76b5339 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:52.295237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5138d42f-2076-47fc-80e8-65a4b76b5339 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:52.297062 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5138d42f-2076-47fc-80e8-65a4b76b5339 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:52.298354 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5138d42f-2076-47fc-80e8-65a4b76b5339 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1338 microversion: 2.20 time: 0.159206 Jun 16 15:04:52.309865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 474/951] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:04:52 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1338 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:04:52.345365 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-064a3d83-8f68-4a0b-b7e0-006071828fa6 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:52.353770 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-064a3d83-8f68-4a0b-b7e0-006071828fa6 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1676 microversion: 2.1 time: 0.187021 Jun 16 15:04:52.354347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 478/952] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:52 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:52.827594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5f44a8d6-900b-42fc-8f48-05e7bf714ffb tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:52.829077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5f44a8d6-900b-42fc-8f48-05e7bf714ffb tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:52.835769 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f44a8d6-900b-42fc-8f48-05e7bf714ffb tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:52.837007 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f44a8d6-900b-42fc-8f48-05e7bf714ffb tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:52.838415 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f44a8d6-900b-42fc-8f48-05e7bf714ffb tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:52.838415 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f44a8d6-900b-42fc-8f48-05e7bf714ffb tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:53.089904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5f44a8d6-900b-42fc-8f48-05e7bf714ffb tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:53.098225 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5f44a8d6-900b-42fc-8f48-05e7bf714ffb tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1366 microversion: 2.1 time: 0.274663 Jun 16 15:04:53.098799 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 475/953] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:52 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:53.316667 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0b96af39-043e-4a08-9c05-b09fbd21c402 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:53.317900 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0b96af39-043e-4a08-9c05-b09fbd21c402 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:53.329161 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0b96af39-043e-4a08-9c05-b09fbd21c402 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:53.332017 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0b96af39-043e-4a08-9c05-b09fbd21c402 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:53.332826 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0b96af39-043e-4a08-9c05-b09fbd21c402 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:53.333289 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0b96af39-043e-4a08-9c05-b09fbd21c402 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:53.371402 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-05df7877-5bc3-4214-b548-24cb7a6bf8c0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:53.372063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-05df7877-5bc3-4214-b548-24cb7a6bf8c0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:53.383566 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-05df7877-5bc3-4214-b548-24cb7a6bf8c0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:53.384210 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-05df7877-5bc3-4214-b548-24cb7a6bf8c0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:53.385088 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-05df7877-5bc3-4214-b548-24cb7a6bf8c0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:53.385539 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-05df7877-5bc3-4214-b548-24cb7a6bf8c0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:53.493874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0b96af39-043e-4a08-9c05-b09fbd21c402 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:53.503039 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0b96af39-043e-4a08-9c05-b09fbd21c402 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:53.504880 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0b96af39-043e-4a08-9c05-b09fbd21c402 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:53.506180 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0b96af39-043e-4a08-9c05-b09fbd21c402 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1405 microversion: 2.20 time: 0.193460 Jun 16 15:04:53.506733 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 479/954] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:04:53 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1405 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:04:53.704327 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-05df7877-5bc3-4214-b548-24cb7a6bf8c0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:53.712798 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-05df7877-5bc3-4214-b548-24cb7a6bf8c0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1653 microversion: 2.1 time: 0.345556 Jun 16 15:04:53.713432 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 476/955] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:53 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1653 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:53.730174 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-84556360-5903-40d4-916c-427ba648e369 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:53.736282 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-84556360-5903-40d4-916c-427ba648e369 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:53.736738 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-84556360-5903-40d4-916c-427ba648e369 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:53.758719 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-84556360-5903-40d4-916c-427ba648e369 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Going to try to start instance {{(pid=124589) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 15:04:53.801223 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-84556360-5903-40d4-916c-427ba648e369 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "POST /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3/action" status: 202 len: 0 microversion: 2.1 time: 0.075191 Jun 16 15:04:53.802105 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 480/956] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Jun 16 15:04:53 2022] POST /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:04:53.812529 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6f775097-83cf-4c5a-8483-8aedfa324532 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:53.812529 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6f775097-83cf-4c5a-8483-8aedfa324532 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:53.817759 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:53.822522 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6f775097-83cf-4c5a-8483-8aedfa324532 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:53.823995 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6f775097-83cf-4c5a-8483-8aedfa324532 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:53.824777 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6f775097-83cf-4c5a-8483-8aedfa324532 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:53.825288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6f775097-83cf-4c5a-8483-8aedfa324532 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:53.940477 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-139ebf24-34ef-483a-9bd9-3bfc68818338 req-37174b00-e765-45b4-bd98-979fdcb37bce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8", "tag": "b8c5c8c1-cea0-4f6d-81a6-8b5e602aa5f3"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:53.950119 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-139ebf24-34ef-483a-9bd9-3bfc68818338 req-37174b00-e765-45b4-bd98-979fdcb37bce service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:53.951156 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-139ebf24-34ef-483a-9bd9-3bfc68818338 req-37174b00-e765-45b4-bd98-979fdcb37bce service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:53.966125 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-139ebf24-34ef-483a-9bd9-3bfc68818338 req-37174b00-e765-45b4-bd98-979fdcb37bce service nova] Creating event network-changed:b8c5c8c1-cea0-4f6d-81a6-8b5e602aa5f3 for instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 on hv-cinder-83716 Jun 16 15:04:53.971373 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-139ebf24-34ef-483a-9bd9-3bfc68818338 req-37174b00-e765-45b4-bd98-979fdcb37bce service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035074 Jun 16 15:04:53.972626 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 481/957] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:04:54.115794 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-900356c7-9eac-4531-b9ef-cb89852c90bb tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:54.118162 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-900356c7-9eac-4531-b9ef-cb89852c90bb tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:54.124628 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-900356c7-9eac-4531-b9ef-cb89852c90bb tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:54.125259 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-900356c7-9eac-4531-b9ef-cb89852c90bb tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:54.125951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-900356c7-9eac-4531-b9ef-cb89852c90bb tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:54.126915 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-900356c7-9eac-4531-b9ef-cb89852c90bb tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:54.266373 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-900356c7-9eac-4531-b9ef-cb89852c90bb tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:54.274132 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-900356c7-9eac-4531-b9ef-cb89852c90bb tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1366 microversion: 2.1 time: 0.162479 Jun 16 15:04:54.274795 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 482/958] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:54 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:54.305552 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6f775097-83cf-4c5a-8483-8aedfa324532 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:54.313158 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6f775097-83cf-4c5a-8483-8aedfa324532 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1662 microversion: 2.1 time: 0.506942 Jun 16 15:04:54.313892 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 477/959] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:53 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1662 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:54.525702 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5a7984b9-e382-407a-8cec-e520d8941a0d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:54.526494 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5a7984b9-e382-407a-8cec-e520d8941a0d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:54.535039 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5a7984b9-e382-407a-8cec-e520d8941a0d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:54.535601 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5a7984b9-e382-407a-8cec-e520d8941a0d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:54.536449 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5a7984b9-e382-407a-8cec-e520d8941a0d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:54.536989 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5a7984b9-e382-407a-8cec-e520d8941a0d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:54.672759 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5a7984b9-e382-407a-8cec-e520d8941a0d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:54.681054 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5a7984b9-e382-407a-8cec-e520d8941a0d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:54.682772 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5a7984b9-e382-407a-8cec-e520d8941a0d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:54.683878 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5a7984b9-e382-407a-8cec-e520d8941a0d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1405 microversion: 2.20 time: 0.162971 Jun 16 15:04:54.684628 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 483/960] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:04:54 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:04:55.291425 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a0680bb2-c241-4665-97ac-7c87dc26e9dd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:55.292029 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a0680bb2-c241-4665-97ac-7c87dc26e9dd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:55.298754 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a0680bb2-c241-4665-97ac-7c87dc26e9dd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:55.299204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a0680bb2-c241-4665-97ac-7c87dc26e9dd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:55.299955 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a0680bb2-c241-4665-97ac-7c87dc26e9dd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:55.300386 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a0680bb2-c241-4665-97ac-7c87dc26e9dd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:55.304408 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:55.330281 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9bc562ec-95bc-4afc-8be4-c38d564bef5a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:55.330814 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9bc562ec-95bc-4afc-8be4-c38d564bef5a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:55.337022 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9bc562ec-95bc-4afc-8be4-c38d564bef5a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:55.337473 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9bc562ec-95bc-4afc-8be4-c38d564bef5a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:55.338260 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9bc562ec-95bc-4afc-8be4-c38d564bef5a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:55.338676 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9bc562ec-95bc-4afc-8be4-c38d564bef5a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:55.436988 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a0680bb2-c241-4665-97ac-7c87dc26e9dd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:55.444575 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a0680bb2-c241-4665-97ac-7c87dc26e9dd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1366 microversion: 2.1 time: 0.156959 Jun 16 15:04:55.445168 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 478/961] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:55 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:55.471331 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9bc562ec-95bc-4afc-8be4-c38d564bef5a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:55.479281 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9bc562ec-95bc-4afc-8be4-c38d564bef5a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1662 microversion: 2.1 time: 0.152851 Jun 16 15:04:55.479828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 484/962] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:55 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:55.701808 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-00fb5315-77a4-4fa1-98f1-c3be25765f40 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:55.702336 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-00fb5315-77a4-4fa1-98f1-c3be25765f40 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:55.708389 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-00fb5315-77a4-4fa1-98f1-c3be25765f40 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:55.708860 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-00fb5315-77a4-4fa1-98f1-c3be25765f40 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:55.709627 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-00fb5315-77a4-4fa1-98f1-c3be25765f40 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:55.710065 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-00fb5315-77a4-4fa1-98f1-c3be25765f40 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:55.837233 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-00fb5315-77a4-4fa1-98f1-c3be25765f40 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:55.845079 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-00fb5315-77a4-4fa1-98f1-c3be25765f40 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:55.846568 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-00fb5315-77a4-4fa1-98f1-c3be25765f40 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:55.847661 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-00fb5315-77a4-4fa1-98f1-c3be25765f40 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1405 microversion: 2.20 time: 0.149908 Jun 16 15:04:55.848238 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 479/963] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:04:55 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:04:55.990054 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-30cfb72c-e703-4dbc-995b-fc4435179ae4 req-c5b45ef7-8e26-41b0-8871-47fc7e90c4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b53e3fc3-e13f-4352-ad2f-7babd83b19e3", "tag": "2fd6981b-720b-4e5e-a50b-00f468402a5f"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:04:55.998644 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-30cfb72c-e703-4dbc-995b-fc4435179ae4 req-c5b45ef7-8e26-41b0-8871-47fc7e90c4e9 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:55.999084 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-30cfb72c-e703-4dbc-995b-fc4435179ae4 req-c5b45ef7-8e26-41b0-8871-47fc7e90c4e9 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:56.009854 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-30cfb72c-e703-4dbc-995b-fc4435179ae4 req-c5b45ef7-8e26-41b0-8871-47fc7e90c4e9 service nova] Creating event network-changed:2fd6981b-720b-4e5e-a50b-00f468402a5f for instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 on hv-cinder-83716 Jun 16 15:04:56.014433 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-30cfb72c-e703-4dbc-995b-fc4435179ae4 req-c5b45ef7-8e26-41b0-8871-47fc7e90c4e9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028108 Jun 16 15:04:56.014996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 485/964] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:04:56.462786 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3b62c0f5-4306-4034-8751-ceb2b0bf69a9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:56.463416 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3b62c0f5-4306-4034-8751-ceb2b0bf69a9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:56.469966 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3b62c0f5-4306-4034-8751-ceb2b0bf69a9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:56.470420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3b62c0f5-4306-4034-8751-ceb2b0bf69a9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:56.471181 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3b62c0f5-4306-4034-8751-ceb2b0bf69a9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:56.471649 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3b62c0f5-4306-4034-8751-ceb2b0bf69a9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:56.496138 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-228bbf7f-7623-4249-8cb2-5deee418930f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:56.496880 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-228bbf7f-7623-4249-8cb2-5deee418930f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:56.503141 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-228bbf7f-7623-4249-8cb2-5deee418930f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:56.503592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-228bbf7f-7623-4249-8cb2-5deee418930f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:56.504349 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-228bbf7f-7623-4249-8cb2-5deee418930f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:56.504803 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-228bbf7f-7623-4249-8cb2-5deee418930f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:56.509461 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:56.609075 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3b62c0f5-4306-4034-8751-ceb2b0bf69a9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:56.616657 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3b62c0f5-4306-4034-8751-ceb2b0bf69a9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1366 microversion: 2.1 time: 0.158266 Jun 16 15:04:56.617267 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 480/965] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:56 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:56.643654 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-228bbf7f-7623-4249-8cb2-5deee418930f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:56.651285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-228bbf7f-7623-4249-8cb2-5deee418930f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1662 microversion: 2.1 time: 0.159496 Jun 16 15:04:56.651841 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 486/966] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:56 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1662 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:56.865965 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1cf96f8a-12e6-4b86-aedd-3400152cf70e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:56.866571 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1cf96f8a-12e6-4b86-aedd-3400152cf70e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:56.873230 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1cf96f8a-12e6-4b86-aedd-3400152cf70e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:56.873679 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1cf96f8a-12e6-4b86-aedd-3400152cf70e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:56.874442 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1cf96f8a-12e6-4b86-aedd-3400152cf70e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:56.874882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1cf96f8a-12e6-4b86-aedd-3400152cf70e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:57.002734 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1cf96f8a-12e6-4b86-aedd-3400152cf70e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:57.011210 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1cf96f8a-12e6-4b86-aedd-3400152cf70e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:57.012715 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1cf96f8a-12e6-4b86-aedd-3400152cf70e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:57.013854 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1cf96f8a-12e6-4b86-aedd-3400152cf70e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1405 microversion: 2.20 time: 0.151819 Jun 16 15:04:57.014542 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 481/967] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:04:56 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:04:57.634305 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2130c01f-f481-4dcd-b6a5-60ea39b43fca tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:57.634901 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2130c01f-f481-4dcd-b6a5-60ea39b43fca tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:57.641492 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2130c01f-f481-4dcd-b6a5-60ea39b43fca tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:57.641953 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2130c01f-f481-4dcd-b6a5-60ea39b43fca tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:57.642718 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2130c01f-f481-4dcd-b6a5-60ea39b43fca tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:57.643155 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2130c01f-f481-4dcd-b6a5-60ea39b43fca tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:57.669308 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-817ce954-ec5d-4d21-803b-999d8799438d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:57.669922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-817ce954-ec5d-4d21-803b-999d8799438d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:57.676562 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-817ce954-ec5d-4d21-803b-999d8799438d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:57.677052 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-817ce954-ec5d-4d21-803b-999d8799438d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:57.677820 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-817ce954-ec5d-4d21-803b-999d8799438d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:57.678261 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-817ce954-ec5d-4d21-803b-999d8799438d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:57.775273 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2130c01f-f481-4dcd-b6a5-60ea39b43fca tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:57.782932 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2130c01f-f481-4dcd-b6a5-60ea39b43fca tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1366 microversion: 2.1 time: 0.152545 Jun 16 15:04:57.783498 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 487/968] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:57 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:57.809703 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-817ce954-ec5d-4d21-803b-999d8799438d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:57.817548 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-817ce954-ec5d-4d21-803b-999d8799438d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1662 microversion: 2.1 time: 0.152830 Jun 16 15:04:57.818109 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 482/969] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:57 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1662 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:58.031834 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c15878ec-3c36-4812-990a-4bc0f965ee16 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:58.032470 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c15878ec-3c36-4812-990a-4bc0f965ee16 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:58.038591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c15878ec-3c36-4812-990a-4bc0f965ee16 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:58.039038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c15878ec-3c36-4812-990a-4bc0f965ee16 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:58.039809 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c15878ec-3c36-4812-990a-4bc0f965ee16 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:58.040244 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c15878ec-3c36-4812-990a-4bc0f965ee16 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:58.174831 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c15878ec-3c36-4812-990a-4bc0f965ee16 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:58.184732 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c15878ec-3c36-4812-990a-4bc0f965ee16 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:58.186377 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c15878ec-3c36-4812-990a-4bc0f965ee16 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:58.187386 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c15878ec-3c36-4812-990a-4bc0f965ee16 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1405 microversion: 2.20 time: 0.159754 Jun 16 15:04:58.188140 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 488/970] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:04:58 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:04:58.800463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c448a6f4-9e27-443c-b398-1d1d78dd3f8e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:58.801104 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c448a6f4-9e27-443c-b398-1d1d78dd3f8e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:58.808276 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c448a6f4-9e27-443c-b398-1d1d78dd3f8e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:58.808730 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c448a6f4-9e27-443c-b398-1d1d78dd3f8e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:58.809627 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c448a6f4-9e27-443c-b398-1d1d78dd3f8e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:58.810080 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c448a6f4-9e27-443c-b398-1d1d78dd3f8e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:58.835135 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f0a6f984-574d-40d5-aff5-41873a3279d1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:58.835747 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f0a6f984-574d-40d5-aff5-41873a3279d1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:58.842325 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0a6f984-574d-40d5-aff5-41873a3279d1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:58.842783 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0a6f984-574d-40d5-aff5-41873a3279d1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:58.843557 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0a6f984-574d-40d5-aff5-41873a3279d1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:58.843997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0a6f984-574d-40d5-aff5-41873a3279d1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:58.948154 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c448a6f4-9e27-443c-b398-1d1d78dd3f8e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:58.956502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c448a6f4-9e27-443c-b398-1d1d78dd3f8e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1366 microversion: 2.1 time: 0.159955 Jun 16 15:04:58.957114 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 483/971] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:58 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:04:58.997988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f0a6f984-574d-40d5-aff5-41873a3279d1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:59.005470 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f0a6f984-574d-40d5-aff5-41873a3279d1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1662 microversion: 2.1 time: 0.174463 Jun 16 15:04:59.006055 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 489/972] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:58 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1662 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:04:59.206428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8ee8facc-9d3c-4584-a53e-f8429afbb681 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:59.206792 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8ee8facc-9d3c-4584-a53e-f8429afbb681 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:59.214371 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8ee8facc-9d3c-4584-a53e-f8429afbb681 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:59.215080 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8ee8facc-9d3c-4584-a53e-f8429afbb681 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:59.216419 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8ee8facc-9d3c-4584-a53e-f8429afbb681 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:59.217162 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8ee8facc-9d3c-4584-a53e-f8429afbb681 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:59.372631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8ee8facc-9d3c-4584-a53e-f8429afbb681 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:59.382536 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8ee8facc-9d3c-4584-a53e-f8429afbb681 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:59.384557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8ee8facc-9d3c-4584-a53e-f8429afbb681 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:04:59.385717 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8ee8facc-9d3c-4584-a53e-f8429afbb681 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1405 microversion: 2.20 time: 0.183686 Jun 16 15:04:59.386283 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 484/973] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:04:59 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:04:59.973793 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-86fe00e6-d193-4601-98a0-ac6c8712ba77 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:04:59.974413 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-86fe00e6-d193-4601-98a0-ac6c8712ba77 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:04:59.978206 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:59.978951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=12 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:04:59.984363 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-86fe00e6-d193-4601-98a0-ac6c8712ba77 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:59.984816 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-86fe00e6-d193-4601-98a0-ac6c8712ba77 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:04:59.985619 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-86fe00e6-d193-4601-98a0-ac6c8712ba77 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:04:59.986058 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-86fe00e6-d193-4601-98a0-ac6c8712ba77 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:00.022533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b3aebdfc-ffd8-44ee-a314-c292a9cca9c3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:00.023158 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b3aebdfc-ffd8-44ee-a314-c292a9cca9c3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:00.027124 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:00.028075 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=12 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:00.034444 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3aebdfc-ffd8-44ee-a314-c292a9cca9c3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:00.035172 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3aebdfc-ffd8-44ee-a314-c292a9cca9c3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:00.036001 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3aebdfc-ffd8-44ee-a314-c292a9cca9c3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:00.036610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3aebdfc-ffd8-44ee-a314-c292a9cca9c3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:00.127934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-86fe00e6-d193-4601-98a0-ac6c8712ba77 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:00.136068 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-86fe00e6-d193-4601-98a0-ac6c8712ba77 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1366 microversion: 2.1 time: 0.166291 Jun 16 15:05:00.136726 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 490/974] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:04:59 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:00.169085 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b3aebdfc-ffd8-44ee-a314-c292a9cca9c3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:00.176684 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b3aebdfc-ffd8-44ee-a314-c292a9cca9c3 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1666 microversion: 2.1 time: 0.158026 Jun 16 15:05:00.177282 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 485/975] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:00 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1666 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:05:00.403686 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6a63369c-a080-4850-b90e-b062e6b99959 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:00.404328 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6a63369c-a080-4850-b90e-b062e6b99959 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:00.410713 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6a63369c-a080-4850-b90e-b062e6b99959 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:00.411163 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6a63369c-a080-4850-b90e-b062e6b99959 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:00.411916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6a63369c-a080-4850-b90e-b062e6b99959 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:00.412350 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6a63369c-a080-4850-b90e-b062e6b99959 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:00.541167 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6a63369c-a080-4850-b90e-b062e6b99959 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:00.549639 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6a63369c-a080-4850-b90e-b062e6b99959 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:00.551164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6a63369c-a080-4850-b90e-b062e6b99959 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:00.552266 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6a63369c-a080-4850-b90e-b062e6b99959 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1405 microversion: 2.20 time: 0.152481 Jun 16 15:05:00.552877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 491/976] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:05:00 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:05:01.153758 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4cbffccf-dfe8-4244-b7be-c63f7f579951 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:01.154366 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4cbffccf-dfe8-4244-b7be-c63f7f579951 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:01.161378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4cbffccf-dfe8-4244-b7be-c63f7f579951 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:01.161843 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4cbffccf-dfe8-4244-b7be-c63f7f579951 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:01.162650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4cbffccf-dfe8-4244-b7be-c63f7f579951 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:01.163108 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4cbffccf-dfe8-4244-b7be-c63f7f579951 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:01.294282 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4cbffccf-dfe8-4244-b7be-c63f7f579951 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:01.301837 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4cbffccf-dfe8-4244-b7be-c63f7f579951 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1366 microversion: 2.1 time: 0.152482 Jun 16 15:05:01.302439 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 486/977] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:01 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:01.570450 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c5253062-697d-4809-9e24-1cdd579af60b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:01.571561 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c5253062-697d-4809-9e24-1cdd579af60b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:01.578238 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c5253062-697d-4809-9e24-1cdd579af60b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:01.578696 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c5253062-697d-4809-9e24-1cdd579af60b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:01.579461 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c5253062-697d-4809-9e24-1cdd579af60b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:01.579899 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c5253062-697d-4809-9e24-1cdd579af60b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:01.714585 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c5253062-697d-4809-9e24-1cdd579af60b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:01.722949 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c5253062-697d-4809-9e24-1cdd579af60b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:01.724455 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c5253062-697d-4809-9e24-1cdd579af60b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:01.725606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c5253062-697d-4809-9e24-1cdd579af60b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1405 microversion: 2.20 time: 0.159099 Jun 16 15:05:01.726169 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 492/978] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:05:01 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:05:01.780091 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-ce92bf55-d0c1-488d-9250-7db2fe8b4c91 req-019b37b9-eabf-4bba-8e39-c28be662dbf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8", "name": "network-vif-plugged", "status": "completed", "tag": "b8c5c8c1-cea0-4f6d-81a6-8b5e602aa5f3"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:05:01.788737 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-ce92bf55-d0c1-488d-9250-7db2fe8b4c91 req-019b37b9-eabf-4bba-8e39-c28be662dbf4 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:01.789427 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-ce92bf55-d0c1-488d-9250-7db2fe8b4c91 req-019b37b9-eabf-4bba-8e39-c28be662dbf4 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:01.800854 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-ce92bf55-d0c1-488d-9250-7db2fe8b4c91 req-019b37b9-eabf-4bba-8e39-c28be662dbf4 service nova] Creating event network-vif-plugged:b8c5c8c1-cea0-4f6d-81a6-8b5e602aa5f3 for instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 on hv-cinder-83716 Jun 16 15:05:01.805826 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-ce92bf55-d0c1-488d-9250-7db2fe8b4c91 req-019b37b9-eabf-4bba-8e39-c28be662dbf4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029388 Jun 16 15:05:01.806420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 487/979] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:05:02.318563 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6110f892-8ace-4b5c-ace2-07feae9dff01 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:02.319167 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6110f892-8ace-4b5c-ace2-07feae9dff01 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:02.325325 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6110f892-8ace-4b5c-ace2-07feae9dff01 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:02.325775 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6110f892-8ace-4b5c-ace2-07feae9dff01 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:02.326555 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6110f892-8ace-4b5c-ace2-07feae9dff01 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:02.326987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6110f892-8ace-4b5c-ace2-07feae9dff01 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:02.457140 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6110f892-8ace-4b5c-ace2-07feae9dff01 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:02.464510 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6110f892-8ace-4b5c-ace2-07feae9dff01 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1366 microversion: 2.1 time: 0.149825 Jun 16 15:05:02.465114 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 493/980] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:02 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:02.744681 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1d94f3bc-b4ca-4be0-b6c9-04fb280fe1af tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:02.745340 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1d94f3bc-b4ca-4be0-b6c9-04fb280fe1af tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:02.751590 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1d94f3bc-b4ca-4be0-b6c9-04fb280fe1af tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:02.752042 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1d94f3bc-b4ca-4be0-b6c9-04fb280fe1af tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:02.752853 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1d94f3bc-b4ca-4be0-b6c9-04fb280fe1af tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:02.753311 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1d94f3bc-b4ca-4be0-b6c9-04fb280fe1af tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:02.883151 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1d94f3bc-b4ca-4be0-b6c9-04fb280fe1af tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:02.891320 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1d94f3bc-b4ca-4be0-b6c9-04fb280fe1af tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:02.892858 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1d94f3bc-b4ca-4be0-b6c9-04fb280fe1af tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:02.893998 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1d94f3bc-b4ca-4be0-b6c9-04fb280fe1af tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1405 microversion: 2.20 time: 0.154162 Jun 16 15:05:02.894553 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 488/981] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:05:02 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:05:03.482535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1e7af757-ef82-46ac-a516-14230b5f38b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:03.483081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1e7af757-ef82-46ac-a516-14230b5f38b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:03.489241 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e7af757-ef82-46ac-a516-14230b5f38b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:03.489696 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e7af757-ef82-46ac-a516-14230b5f38b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:03.490458 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e7af757-ef82-46ac-a516-14230b5f38b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:03.490898 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e7af757-ef82-46ac-a516-14230b5f38b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:03.618624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1e7af757-ef82-46ac-a516-14230b5f38b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:03.626156 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1e7af757-ef82-46ac-a516-14230b5f38b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1366 microversion: 2.1 time: 0.148012 Jun 16 15:05:03.626718 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 494/982] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:03 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:03.912306 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-86b17e70-734b-4c7a-b795-df286e5ecd9b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:03.912941 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-86b17e70-734b-4c7a-b795-df286e5ecd9b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:03.919453 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-86b17e70-734b-4c7a-b795-df286e5ecd9b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:03.919902 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-86b17e70-734b-4c7a-b795-df286e5ecd9b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:03.920666 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-86b17e70-734b-4c7a-b795-df286e5ecd9b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:03.921129 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-86b17e70-734b-4c7a-b795-df286e5ecd9b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:04.053495 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-86b17e70-734b-4c7a-b795-df286e5ecd9b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:04.061481 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-86b17e70-734b-4c7a-b795-df286e5ecd9b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:04.062977 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-86b17e70-734b-4c7a-b795-df286e5ecd9b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:04.064068 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-86b17e70-734b-4c7a-b795-df286e5ecd9b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1405 microversion: 2.20 time: 0.155680 Jun 16 15:05:04.064622 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 489/983] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:05:03 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:05:04.647108 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fce53016-5899-4b19-bfe1-c5864ed67aef tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:04.647656 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fce53016-5899-4b19-bfe1-c5864ed67aef tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:04.654862 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fce53016-5899-4b19-bfe1-c5864ed67aef tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:04.655351 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fce53016-5899-4b19-bfe1-c5864ed67aef tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:04.656370 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fce53016-5899-4b19-bfe1-c5864ed67aef tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:04.656885 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fce53016-5899-4b19-bfe1-c5864ed67aef tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:04.788805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fce53016-5899-4b19-bfe1-c5864ed67aef tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:04.797342 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fce53016-5899-4b19-bfe1-c5864ed67aef tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1366 microversion: 2.1 time: 0.154071 Jun 16 15:05:04.797951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 495/984] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:04 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:05.082414 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4bc310dc-ec42-46bc-adb1-b25ad3f97a6b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:05.083056 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4bc310dc-ec42-46bc-adb1-b25ad3f97a6b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:05.089491 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4bc310dc-ec42-46bc-adb1-b25ad3f97a6b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:05.089950 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4bc310dc-ec42-46bc-adb1-b25ad3f97a6b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:05.090714 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4bc310dc-ec42-46bc-adb1-b25ad3f97a6b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:05.091154 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4bc310dc-ec42-46bc-adb1-b25ad3f97a6b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:05.219162 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4bc310dc-ec42-46bc-adb1-b25ad3f97a6b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:05.227854 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4bc310dc-ec42-46bc-adb1-b25ad3f97a6b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:05.229437 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4bc310dc-ec42-46bc-adb1-b25ad3f97a6b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:05.230560 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4bc310dc-ec42-46bc-adb1-b25ad3f97a6b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1405 microversion: 2.20 time: 0.152105 Jun 16 15:05:05.231130 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 490/985] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:05:05 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:05:05.814272 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8f9ce20c-4f0f-44b8-9d02-cdd9c3d89170 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:05.814870 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8f9ce20c-4f0f-44b8-9d02-cdd9c3d89170 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:05.821905 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8f9ce20c-4f0f-44b8-9d02-cdd9c3d89170 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:05.822345 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8f9ce20c-4f0f-44b8-9d02-cdd9c3d89170 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:05.823091 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8f9ce20c-4f0f-44b8-9d02-cdd9c3d89170 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:05.823520 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8f9ce20c-4f0f-44b8-9d02-cdd9c3d89170 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:05.955616 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8f9ce20c-4f0f-44b8-9d02-cdd9c3d89170 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:05.963367 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8f9ce20c-4f0f-44b8-9d02-cdd9c3d89170 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1556 microversion: 2.1 time: 0.152904 Jun 16 15:05:05.963964 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 496/986] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:05 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:05.980664 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-50c9a8e7-5b16-41bf-b845-7b74ec4b3f40 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:05.981188 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-50c9a8e7-5b16-41bf-b845-7b74ec4b3f40 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:05.987295 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-50c9a8e7-5b16-41bf-b845-7b74ec4b3f40 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:05.987755 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-50c9a8e7-5b16-41bf-b845-7b74ec4b3f40 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:05.988526 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-50c9a8e7-5b16-41bf-b845-7b74ec4b3f40 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:05.989607 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-50c9a8e7-5b16-41bf-b845-7b74ec4b3f40 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:06.074197 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-50c9a8e7-5b16-41bf-b845-7b74ec4b3f40 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097834 Jun 16 15:05:06.074794 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 491/987] 10.222.0.72 () {58 vars in 1274 bytes} [Thu Jun 16 15:05:05 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:05:06.247572 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f6033398-f544-4e3c-9795-9a4a02a59fc2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:06.248224 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f6033398-f544-4e3c-9795-9a4a02a59fc2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:06.254321 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f6033398-f544-4e3c-9795-9a4a02a59fc2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:06.254858 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f6033398-f544-4e3c-9795-9a4a02a59fc2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:06.255603 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f6033398-f544-4e3c-9795-9a4a02a59fc2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:06.256039 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f6033398-f544-4e3c-9795-9a4a02a59fc2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:06.391349 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f6033398-f544-4e3c-9795-9a4a02a59fc2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:06.399682 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f6033398-f544-4e3c-9795-9a4a02a59fc2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:06.401270 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f6033398-f544-4e3c-9795-9a4a02a59fc2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:06.402382 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f6033398-f544-4e3c-9795-9a4a02a59fc2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1405 microversion: 2.20 time: 0.158792 Jun 16 15:05:06.413441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 497/988] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:05:06 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:05:06.982851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-4c88b999-8649-4df0-b38d-a9d8259556c2 req-ba79d144-0ee1-4473-9d3c-ea8fac6bbf65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8", "tag": "b8c5c8c1-cea0-4f6d-81a6-8b5e602aa5f3"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:05:06.990862 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-4c88b999-8649-4df0-b38d-a9d8259556c2 req-ba79d144-0ee1-4473-9d3c-ea8fac6bbf65 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:06.991790 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-4c88b999-8649-4df0-b38d-a9d8259556c2 req-ba79d144-0ee1-4473-9d3c-ea8fac6bbf65 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:07.004831 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-4c88b999-8649-4df0-b38d-a9d8259556c2 req-ba79d144-0ee1-4473-9d3c-ea8fac6bbf65 service nova] Creating event network-changed:b8c5c8c1-cea0-4f6d-81a6-8b5e602aa5f3 for instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 on hv-cinder-83716 Jun 16 15:05:07.009991 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-4c88b999-8649-4df0-b38d-a9d8259556c2 req-ba79d144-0ee1-4473-9d3c-ea8fac6bbf65 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031251 Jun 16 15:05:07.010866 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 492/989] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:05:07.421157 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4a120656-6f33-44ae-a62b-e5b874b990db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:07.421765 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4a120656-6f33-44ae-a62b-e5b874b990db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:07.429948 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4a120656-6f33-44ae-a62b-e5b874b990db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:07.430427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4a120656-6f33-44ae-a62b-e5b874b990db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:07.431195 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4a120656-6f33-44ae-a62b-e5b874b990db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:07.431623 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4a120656-6f33-44ae-a62b-e5b874b990db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:07.571288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4a120656-6f33-44ae-a62b-e5b874b990db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:07.581910 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4a120656-6f33-44ae-a62b-e5b874b990db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:07.583450 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4a120656-6f33-44ae-a62b-e5b874b990db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:07.584541 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4a120656-6f33-44ae-a62b-e5b874b990db tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1405 microversion: 2.20 time: 0.167308 Jun 16 15:05:07.585329 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 498/990] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:05:07 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:05:07.735936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-30b9df5f-2b11-43a0-bbd6-87aaf7753e8c req-63b93a62-3bb4-4cbd-ab9b-170fa08250c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53e3fc3-e13f-4352-ad2f-7babd83b19e3", "name": "network-vif-plugged", "status": "completed", "tag": "2fd6981b-720b-4e5e-a50b-00f468402a5f"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:05:07.746625 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-30b9df5f-2b11-43a0-bbd6-87aaf7753e8c req-63b93a62-3bb4-4cbd-ab9b-170fa08250c6 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:07.747073 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-30b9df5f-2b11-43a0-bbd6-87aaf7753e8c req-63b93a62-3bb4-4cbd-ab9b-170fa08250c6 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:07.759055 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-30b9df5f-2b11-43a0-bbd6-87aaf7753e8c req-63b93a62-3bb4-4cbd-ab9b-170fa08250c6 service nova] Creating event network-vif-plugged:2fd6981b-720b-4e5e-a50b-00f468402a5f for instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 on hv-cinder-83716 Jun 16 15:05:07.764235 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-30b9df5f-2b11-43a0-bbd6-87aaf7753e8c req-63b93a62-3bb4-4cbd-ab9b-170fa08250c6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033177 Jun 16 15:05:07.765345 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 493/991] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:05:08.603286 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b27b4960-3e93-4480-921f-b15106dc2038 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:08.603875 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b27b4960-3e93-4480-921f-b15106dc2038 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:08.610434 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b27b4960-3e93-4480-921f-b15106dc2038 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:08.610888 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b27b4960-3e93-4480-921f-b15106dc2038 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:08.611651 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b27b4960-3e93-4480-921f-b15106dc2038 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:08.612085 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b27b4960-3e93-4480-921f-b15106dc2038 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:08.741271 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b27b4960-3e93-4480-921f-b15106dc2038 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:08.749110 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b27b4960-3e93-4480-921f-b15106dc2038 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:08.750733 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b27b4960-3e93-4480-921f-b15106dc2038 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:08.751863 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b27b4960-3e93-4480-921f-b15106dc2038 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1405 microversion: 2.20 time: 0.152914 Jun 16 15:05:08.752564 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 499/992] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:05:08 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:05:09.770255 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-67ac5dd9-0af1-4910-842d-85a9a01f9fd1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:09.770949 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-67ac5dd9-0af1-4910-842d-85a9a01f9fd1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:09.778286 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67ac5dd9-0af1-4910-842d-85a9a01f9fd1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:09.778743 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67ac5dd9-0af1-4910-842d-85a9a01f9fd1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:09.779510 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67ac5dd9-0af1-4910-842d-85a9a01f9fd1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:09.779951 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67ac5dd9-0af1-4910-842d-85a9a01f9fd1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:09.916034 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-67ac5dd9-0af1-4910-842d-85a9a01f9fd1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:09.924015 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-67ac5dd9-0af1-4910-842d-85a9a01f9fd1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:09.925566 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-67ac5dd9-0af1-4910-842d-85a9a01f9fd1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:09.926670 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-67ac5dd9-0af1-4910-842d-85a9a01f9fd1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1405 microversion: 2.20 time: 0.160700 Jun 16 15:05:09.927218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 494/993] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:05:09 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1405 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:05:10.944175 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-689c65b9-cc4f-4409-970c-be0a43861719 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:10.944782 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-689c65b9-cc4f-4409-970c-be0a43861719 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:10.951495 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-689c65b9-cc4f-4409-970c-be0a43861719 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:10.951947 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-689c65b9-cc4f-4409-970c-be0a43861719 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:10.952715 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-689c65b9-cc4f-4409-970c-be0a43861719 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:10.953181 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-689c65b9-cc4f-4409-970c-be0a43861719 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:11.084072 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-689c65b9-cc4f-4409-970c-be0a43861719 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:11.092623 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-689c65b9-cc4f-4409-970c-be0a43861719 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:11.094155 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-689c65b9-cc4f-4409-970c-be0a43861719 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:11.095307 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-689c65b9-cc4f-4409-970c-be0a43861719 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1596 microversion: 2.20 time: 0.155095 Jun 16 15:05:11.095865 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 500/994] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:05:10 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1596 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:05:11.112647 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-23d0c573-c3b4-4734-856b-a708db83af65 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:11.113168 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-23d0c573-c3b4-4734-856b-a708db83af65 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:11.119779 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-23d0c573-c3b4-4734-856b-a708db83af65 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:11.120225 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-23d0c573-c3b4-4734-856b-a708db83af65 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:11.121004 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-23d0c573-c3b4-4734-856b-a708db83af65 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:11.121439 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-23d0c573-c3b4-4734-856b-a708db83af65 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:11.205632 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-23d0c573-c3b4-4734-856b-a708db83af65 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096749 Jun 16 15:05:11.206246 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 495/995] 10.222.0.72 () {60 vars in 1315 bytes} [Thu Jun 16 15:05:11 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 15:05:12.329121 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-d9c8f513-0968-4ff0-b765-2ec67187fc6a req-d3769f31-9c1b-49b3-b9bc-e35bc8f9cfd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b53e3fc3-e13f-4352-ad2f-7babd83b19e3", "tag": "2fd6981b-720b-4e5e-a50b-00f468402a5f"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:05:12.337747 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-d9c8f513-0968-4ff0-b765-2ec67187fc6a req-d3769f31-9c1b-49b3-b9bc-e35bc8f9cfd7 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:12.338193 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-d9c8f513-0968-4ff0-b765-2ec67187fc6a req-d3769f31-9c1b-49b3-b9bc-e35bc8f9cfd7 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:12.349088 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-d9c8f513-0968-4ff0-b765-2ec67187fc6a req-d3769f31-9c1b-49b3-b9bc-e35bc8f9cfd7 service nova] Creating event network-changed:2fd6981b-720b-4e5e-a50b-00f468402a5f for instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 on hv-cinder-83716 Jun 16 15:05:12.354781 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-d9c8f513-0968-4ff0-b765-2ec67187fc6a req-d3769f31-9c1b-49b3-b9bc-e35bc8f9cfd7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029277 Jun 16 15:05:12.355548 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 501/996] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:05:39.907416 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=37 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:39.908224 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=90 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:39.912793 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8ec71601-494b-4211-b85f-5dafab150fa7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1389256946"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:05:39.913361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8ec71601-494b-4211-b85f-5dafab150fa7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:39.920113 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8ec71601-494b-4211-b85f-5dafab150fa7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:39.920576 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8ec71601-494b-4211-b85f-5dafab150fa7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:39.921366 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8ec71601-494b-4211-b85f-5dafab150fa7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:39.921815 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8ec71601-494b-4211-b85f-5dafab150fa7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:40.050980 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.network.security_group_api [None req-8ec71601-494b-4211-b85f-5dafab150fa7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Removing security group 2fb7ef3c-5da8-4b98-a2fa-6921b88e8578 from port 186c05a0-cf63-4d64-870c-57ea93435c68 Jun 16 15:05:40.393981 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8ec71601-494b-4211-b85f-5dafab150fa7 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "POST /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8/action" status: 202 len: 0 microversion: 2.1 time: 0.488154 Jun 16 15:05:40.398193 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 496/997] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Jun 16 15:05:39 2022] POST /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:05:40.410645 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:40.411392 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=90 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:05:40.416019 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-968a4115-bd4a-4431-b480-a1ae1fb5e28e req-800456c6-ab56-4af2-aeeb-d1b896a57afd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55d202da-a7dd-4ab3-8d48-fda5c914f3c8", "tag": "186c05a0-cf63-4d64-870c-57ea93435c68"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:05:40.442408 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-968a4115-bd4a-4431-b480-a1ae1fb5e28e req-800456c6-ab56-4af2-aeeb-d1b896a57afd service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:40.443404 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-968a4115-bd4a-4431-b480-a1ae1fb5e28e req-800456c6-ab56-4af2-aeeb-d1b896a57afd service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:40.459007 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-968a4115-bd4a-4431-b480-a1ae1fb5e28e req-800456c6-ab56-4af2-aeeb-d1b896a57afd service nova] Creating event network-changed:186c05a0-cf63-4d64-870c-57ea93435c68 for instance 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 on hv-cinder-83716 Jun 16 15:05:40.464985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-968a4115-bd4a-4431-b480-a1ae1fb5e28e req-800456c6-ab56-4af2-aeeb-d1b896a57afd service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066533 Jun 16 15:05:40.469670 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 502/998] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:05:41.435453 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-412a86d5-dbd8-4cbf-a8ce-ed7fe5cd9e0b req-444e8b92-59e0-4790-bafe-5d7915e66ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55d202da-a7dd-4ab3-8d48-fda5c914f3c8", "tag": "186c05a0-cf63-4d64-870c-57ea93435c68"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:05:41.437826 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8c3a82b3-057c-4221-a14e-4b4a00a0f170 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:41.438453 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8c3a82b3-057c-4221-a14e-4b4a00a0f170 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:41.444515 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-412a86d5-dbd8-4cbf-a8ce-ed7fe5cd9e0b req-444e8b92-59e0-4790-bafe-5d7915e66ae6 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:41.445071 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-412a86d5-dbd8-4cbf-a8ce-ed7fe5cd9e0b req-444e8b92-59e0-4790-bafe-5d7915e66ae6 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:41.445197 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c3a82b3-057c-4221-a14e-4b4a00a0f170 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:41.446021 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c3a82b3-057c-4221-a14e-4b4a00a0f170 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:41.446384 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c3a82b3-057c-4221-a14e-4b4a00a0f170 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:41.446858 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c3a82b3-057c-4221-a14e-4b4a00a0f170 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:41.456812 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-412a86d5-dbd8-4cbf-a8ce-ed7fe5cd9e0b req-444e8b92-59e0-4790-bafe-5d7915e66ae6 service nova] Creating event network-changed:186c05a0-cf63-4d64-870c-57ea93435c68 for instance 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 on hv-cinder-83716 Jun 16 15:05:41.462179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-412a86d5-dbd8-4cbf-a8ce-ed7fe5cd9e0b req-444e8b92-59e0-4790-bafe-5d7915e66ae6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031776 Jun 16 15:05:41.462999 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 503/999] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:05:41.532665 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-8c3a82b3-057c-4221-a14e-4b4a00a0f170 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lazy-loading 'services' on Instance uuid 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:05:41.620117 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8c3a82b3-057c-4221-a14e-4b4a00a0f170 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "DELETE /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8/os-volume_attachments/99b8a2b2-f026-4839-aa93-3e0476c5473d" status: 202 len: 0 microversion: 2.1 time: 0.193815 Jun 16 15:05:41.621127 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 497/1000] 10.222.0.72 () {58 vars in 1415 bytes} [Thu Jun 16 15:05:41 2022] DELETE /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8/os-volume_attachments/99b8a2b2-f026-4839-aa93-3e0476c5473d => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:05:41.630115 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9dce5a25-2e57-4e51-81fe-d48b3126c9a4 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:41.631124 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9dce5a25-2e57-4e51-81fe-d48b3126c9a4 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:41.639343 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9dce5a25-2e57-4e51-81fe-d48b3126c9a4 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:41.640313 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9dce5a25-2e57-4e51-81fe-d48b3126c9a4 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:41.641290 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9dce5a25-2e57-4e51-81fe-d48b3126c9a4 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:41.641888 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9dce5a25-2e57-4e51-81fe-d48b3126c9a4 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:41.676612 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9dce5a25-2e57-4e51-81fe-d48b3126c9a4 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050702 Jun 16 15:05:41.677214 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 504/1001] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:05:41 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:05:42.689533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9fda23fd-9af2-4e42-9b89-8d1af21534bf tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:42.690538 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9fda23fd-9af2-4e42-9b89-8d1af21534bf tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:42.696646 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9fda23fd-9af2-4e42-9b89-8d1af21534bf tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:42.697124 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9fda23fd-9af2-4e42-9b89-8d1af21534bf tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:42.698370 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9fda23fd-9af2-4e42-9b89-8d1af21534bf tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:42.698803 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9fda23fd-9af2-4e42-9b89-8d1af21534bf tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:42.726856 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9fda23fd-9af2-4e42-9b89-8d1af21534bf tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042288 Jun 16 15:05:42.727399 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 498/1002] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:05:42 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:05:43.738955 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ddb6a9b9-d4dc-413f-a14b-45baa312c4b2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:43.739877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ddb6a9b9-d4dc-413f-a14b-45baa312c4b2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:43.746457 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddb6a9b9-d4dc-413f-a14b-45baa312c4b2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:43.746909 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddb6a9b9-d4dc-413f-a14b-45baa312c4b2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:43.747669 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddb6a9b9-d4dc-413f-a14b-45baa312c4b2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:43.748106 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddb6a9b9-d4dc-413f-a14b-45baa312c4b2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:43.776787 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ddb6a9b9-d4dc-413f-a14b-45baa312c4b2 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042044 Jun 16 15:05:43.777369 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 505/1003] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:05:43 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 15:05:43.787216 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a0ac5e84-710b-4864-b1c0-2ae913a7f495 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:43.787706 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a0ac5e84-710b-4864-b1c0-2ae913a7f495 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:43.794145 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a0ac5e84-710b-4864-b1c0-2ae913a7f495 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:43.794589 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a0ac5e84-710b-4864-b1c0-2ae913a7f495 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:43.795337 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a0ac5e84-710b-4864-b1c0-2ae913a7f495 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:43.795770 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a0ac5e84-710b-4864-b1c0-2ae913a7f495 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:43.867920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-a0ac5e84-710b-4864-b1c0-2ae913a7f495 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] HTTP exception thrown: Instance 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 is not attached to volume 99b8a2b2-f026-4839-aa93-3e0476c5473d Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a0ac5e84-710b-4864-b1c0-2ae913a7f495 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Request method failure captured: Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: DELETE /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8/os-volume_attachments/99b8a2b2-f026-4839-aa93-3e0476c5473d HTTP/1.1 Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0WtxdLuMttCIYOydxdQUi0n-9S2a5OcO5OLHguM_KDQ_XV7HZEiSvrenXeRJ1TgEkoV9Yp8FmwRzToGEBsQCwCF0CYk-3m6M1LpJ-yNCZ9fNZyGn8NWwyGNL4EJLyvVnniWrBx1xD73gqkJl-J3UtizJcb0Nj8ZwVwlyUb0ZwFQ4I0 Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 3048a9bbedf74d49a27c9911ca2ad960 Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-TestMinimumBasicScenario-679939397 Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:05:43.891017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:05:43.892680 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3048a9bbedf74d49a27c9911ca2ad960", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3048a9bbedf74d49a27c9911ca2ad960"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3048a9bbedf74d49a27c9911ca2ad960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3048a9bbedf74d49a27c9911ca2ad960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:05:43.892680 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-TestMinimumBasicScenario-679939397 Jun 16 15:05:43.892680 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 3048a9bbedf74d49a27c9911ca2ad960 Jun 16 15:05:43.892680 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-TestMinimumBasicScenario-679939397 Jun 16 15:05:43.892680 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-TestMinimumBasicScenario-679939397-project Jun 16 15:05:43.892680 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:05:43.892680 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:05:43.892680 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: d0b498bcfc434db99010657e2ab544b9 Jun 16 15:05:43.892680 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-TestMinimumBasicScenario-679939397-project Jun 16 15:05:43.892680 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:05:43.892680 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 is not attached to volume 99b8a2b2-f026-4839-aa93-3e0476c5473d Jun 16 15:05:43.893528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'server_id': '55d202da-a7dd-4ab3-8d48-fda5c914f3c8', 'id': '99b8a2b2-f026-4839-aa93-3e0476c5473d'} Jun 16 15:05:43.893528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:05:43.893528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:05:43.893528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 15:05:43.893528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 15:05:43.893528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 15:05:43.893528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 15:05:43.893528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 15:05:43.893528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 15:05:43.893528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 99b8a2b2-f026-4839-aa93-3e0476c5473d. Jun 16 15:05:43.893528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:05:43.893528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:05:43.893528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:05:43.893528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:05:43.893528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:05:43.893528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:05:43.893528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:05:43.893528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:05:43.893528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:05:43.895008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:05:43.895008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 15:05:43.895008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 15:05:43.895008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 is not attached to volume 99b8a2b2-f026-4839-aa93-3e0476c5473d Jun 16 15:05:43.895008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:05:43.895008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:05:43.895008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:05:43.895008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:05:43.895008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:05:43.895008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:05:43.895008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:05:43.895008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:05:43.895008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 is not attached to volume 99b8a2b2-f026-4839-aa93-3e0476c5473d Jun 16 15:05:43.895008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:05:43.895008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a0ac5e84-710b-4864-b1c0-2ae913a7f495 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Returning 404 to user: Instance 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 is not attached to volume 99b8a2b2-f026-4839-aa93-3e0476c5473d {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:05:43.896139 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a0ac5e84-710b-4864-b1c0-2ae913a7f495 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "DELETE /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8/os-volume_attachments/99b8a2b2-f026-4839-aa93-3e0476c5473d" status: 404 len: 154 microversion: 2.1 time: 0.109269 Jun 16 15:05:43.896139 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 499/1004] 10.222.0.72 () {58 vars in 1415 bytes} [Thu Jun 16 15:05:43 2022] DELETE /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8/os-volume_attachments/99b8a2b2-f026-4839-aa93-3e0476c5473d => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:05:45.024689 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-262b71cc-175e-4731-9485-1b66b165f29a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:45.025236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-262b71cc-175e-4731-9485-1b66b165f29a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:45.031846 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-262b71cc-175e-4731-9485-1b66b165f29a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:45.032291 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-262b71cc-175e-4731-9485-1b66b165f29a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:45.033086 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-262b71cc-175e-4731-9485-1b66b165f29a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:45.033519 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-262b71cc-175e-4731-9485-1b66b165f29a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:45.058123 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-262b71cc-175e-4731-9485-1b66b165f29a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:05:45.131454 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-262b71cc-175e-4731-9485-1b66b165f29a tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "DELETE /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 204 len: 0 microversion: 2.1 time: 0.110209 Jun 16 15:05:45.132073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 506/1005] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:05:45 2022] DELETE /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:05:45.140731 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5ce559cf-cc19-40a2-babf-dbca68131615 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:45.141310 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5ce559cf-cc19-40a2-babf-dbca68131615 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:45.147379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5ce559cf-cc19-40a2-babf-dbca68131615 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:45.147827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5ce559cf-cc19-40a2-babf-dbca68131615 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:45.148588 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5ce559cf-cc19-40a2-babf-dbca68131615 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:45.149066 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5ce559cf-cc19-40a2-babf-dbca68131615 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:45.277724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5ce559cf-cc19-40a2-babf-dbca68131615 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:45.285519 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5ce559cf-cc19-40a2-babf-dbca68131615 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1554 microversion: 2.1 time: 0.148978 Jun 16 15:05:45.286073 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 500/1006] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:45 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:46.303324 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1b6f87db-6326-4458-9dc4-87bf92421d84 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:46.304018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1b6f87db-6326-4458-9dc4-87bf92421d84 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:46.310519 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b6f87db-6326-4458-9dc4-87bf92421d84 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:46.310962 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b6f87db-6326-4458-9dc4-87bf92421d84 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:46.311712 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b6f87db-6326-4458-9dc4-87bf92421d84 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:46.312137 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b6f87db-6326-4458-9dc4-87bf92421d84 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:46.443100 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1b6f87db-6326-4458-9dc4-87bf92421d84 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:46.452632 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1b6f87db-6326-4458-9dc4-87bf92421d84 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1554 microversion: 2.1 time: 0.153491 Jun 16 15:05:46.454235 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 507/1007] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:46 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:47.470754 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-24b9da3e-a73e-446c-b282-07fdd9f9a315 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:47.471366 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-24b9da3e-a73e-446c-b282-07fdd9f9a315 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:47.477886 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24b9da3e-a73e-446c-b282-07fdd9f9a315 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:47.478340 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24b9da3e-a73e-446c-b282-07fdd9f9a315 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:47.479132 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24b9da3e-a73e-446c-b282-07fdd9f9a315 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:47.479571 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24b9da3e-a73e-446c-b282-07fdd9f9a315 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:47.613352 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-24b9da3e-a73e-446c-b282-07fdd9f9a315 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:47.621376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-24b9da3e-a73e-446c-b282-07fdd9f9a315 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1554 microversion: 2.1 time: 0.153927 Jun 16 15:05:47.621936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 501/1008] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:47 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:48.070223 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-b469a256-c9c9-4e81-8b82-0adc7edc5211 req-e47ad390-c69e-4064-bd52-1ab00d38c5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55d202da-a7dd-4ab3-8d48-fda5c914f3c8", "name": "network-vif-deleted", "tag": "186c05a0-cf63-4d64-870c-57ea93435c68"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:05:48.081176 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-b469a256-c9c9-4e81-8b82-0adc7edc5211 req-e47ad390-c69e-4064-bd52-1ab00d38c5e7 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:48.081622 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-b469a256-c9c9-4e81-8b82-0adc7edc5211 req-e47ad390-c69e-4064-bd52-1ab00d38c5e7 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:48.093480 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-b469a256-c9c9-4e81-8b82-0adc7edc5211 req-e47ad390-c69e-4064-bd52-1ab00d38c5e7 service nova] Creating event network-vif-deleted:186c05a0-cf63-4d64-870c-57ea93435c68 for instance 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 on hv-cinder-83716 Jun 16 15:05:48.099082 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-b469a256-c9c9-4e81-8b82-0adc7edc5211 req-e47ad390-c69e-4064-bd52-1ab00d38c5e7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033105 Jun 16 15:05:48.099728 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 508/1009] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:05:48.638548 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a49f7ee1-2038-4e63-9f0f-bbe8c1e9f458 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:48.639082 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a49f7ee1-2038-4e63-9f0f-bbe8c1e9f458 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:48.645598 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a49f7ee1-2038-4e63-9f0f-bbe8c1e9f458 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:48.646048 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a49f7ee1-2038-4e63-9f0f-bbe8c1e9f458 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:48.646802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a49f7ee1-2038-4e63-9f0f-bbe8c1e9f458 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:48.647238 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a49f7ee1-2038-4e63-9f0f-bbe8c1e9f458 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:48.834719 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a49f7ee1-2038-4e63-9f0f-bbe8c1e9f458 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:48.835266 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a49f7ee1-2038-4e63-9f0f-bbe8c1e9f458 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:48.835824 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-a49f7ee1-2038-4e63-9f0f-bbe8c1e9f458 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lazy-loading 'fault' on Instance uuid 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:05:48.881097 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a49f7ee1-2038-4e63-9f0f-bbe8c1e9f458 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0b498bcfc434db99010657e2ab544b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3048a9bbedf74d49a27c9911ca2ad960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:48.889159 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a49f7ee1-2038-4e63-9f0f-bbe8c1e9f458 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 200 len: 1348 microversion: 2.1 time: 0.254594 Jun 16 15:05:48.889659 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 502/1010] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:48 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 1348 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:49.907658 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5a16397c-a110-4f4b-be19-e5dd8ba48b25 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:49.908359 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5a16397c-a110-4f4b-be19-e5dd8ba48b25 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] [instance: 55d202da-a7dd-4ab3-8d48-fda5c914f3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:49.914691 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5a16397c-a110-4f4b-be19-e5dd8ba48b25 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:49.915143 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5a16397c-a110-4f4b-be19-e5dd8ba48b25 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:49.915901 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5a16397c-a110-4f4b-be19-e5dd8ba48b25 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:49.916337 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5a16397c-a110-4f4b-be19-e5dd8ba48b25 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:49.930031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-5a16397c-a110-4f4b-be19-e5dd8ba48b25 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] HTTP exception thrown: Instance 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 could not be found. Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5a16397c-a110-4f4b-be19-e5dd8ba48b25 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Request method failure captured: Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 HTTP/1.1 Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0WtxdLuMttCIYOydxdQUi0n-9S2a5OcO5OLHguM_KDQ_XV7HZEiSvrenXeRJ1TgEkoV9Yp8FmwRzToGEBsQCwCF0CYk-3m6M1LpJ-yNCZ9fNZyGn8NWwyGNL4EJLyvVnniWrBx1xD73gqkJl-J3UtizJcb0Nj8ZwVwlyUb0ZwFQ4I0 Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 3048a9bbedf74d49a27c9911ca2ad960 Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-TestMinimumBasicScenario-679939397 Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 15:05:49.931663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 15:05:49.933319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3048a9bbedf74d49a27c9911ca2ad960", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3048a9bbedf74d49a27c9911ca2ad960"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3048a9bbedf74d49a27c9911ca2ad960"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3048a9bbedf74d49a27c9911ca2ad960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:05:49.933319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-TestMinimumBasicScenario-679939397 Jun 16 15:05:49.933319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 3048a9bbedf74d49a27c9911ca2ad960 Jun 16 15:05:49.933319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-TestMinimumBasicScenario-679939397 Jun 16 15:05:49.933319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-TestMinimumBasicScenario-679939397-project Jun 16 15:05:49.933319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 15:05:49.933319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 15:05:49.933319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: d0b498bcfc434db99010657e2ab544b9 Jun 16 15:05:49.933319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-TestMinimumBasicScenario-679939397-project Jun 16 15:05:49.933319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 15:05:49.933319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 could not be found. Jun 16 15:05:49.933319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': '55d202da-a7dd-4ab3-8d48-fda5c914f3c8'} Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 could not be found. Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:05:49.934396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:05:49.935929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:05:49.935929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:05:49.935929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:05:49.935929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:05:49.935929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:05:49.935929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:05:49.935929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:05:49.935929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 could not be found. Jun 16 15:05:49.935929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:05:49.935929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:05:49.935929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:05:49.935929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:05:49.935929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:05:49.935929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:05:49.935929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:05:49.935929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:05:49.935929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 could not be found. Jun 16 15:05:49.935929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:05:49.937496 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5a16397c-a110-4f4b-be19-e5dd8ba48b25 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Returning 404 to user: Instance 55d202da-a7dd-4ab3-8d48-fda5c914f3c8 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:05:49.937496 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5a16397c-a110-4f4b-be19-e5dd8ba48b25 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8" status: 404 len: 111 microversion: 2.1 time: 0.030870 Jun 16 15:05:49.937496 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 509/1011] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:49 2022] GET /compute/v2.1/servers/55d202da-a7dd-4ab3-8d48-fda5c914f3c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 15:05:49.941714 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f007d6d7-a25a-403e-9bdd-252d24410632 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] Calling method '.version_select at 0x7faab62575e0>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:49.959367 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f007d6d7-a25a-403e-9bdd-252d24410632 tempest-TestMinimumBasicScenario-679939397 tempest-TestMinimumBasicScenario-679939397-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1691632596" status: 202 len: 0 microversion: 2.1 time: 0.021402 Jun 16 15:05:49.959913 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 503/1012] 10.222.0.72 () {58 vars in 1271 bytes} [Thu Jun 16 15:05:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1691632596 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:05:50.845000 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-45764ae5-e842-4773-bbc5-df3237b8765b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:50.845509 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-45764ae5-e842-4773-bbc5-df3237b8765b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:50.851914 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-45764ae5-e842-4773-bbc5-df3237b8765b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:50.852357 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-45764ae5-e842-4773-bbc5-df3237b8765b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:50.853151 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-45764ae5-e842-4773-bbc5-df3237b8765b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:50.853583 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-45764ae5-e842-4773-bbc5-df3237b8765b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:50.942640 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-45764ae5-e842-4773-bbc5-df3237b8765b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lazy-loading 'services' on Instance uuid 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:05:51.019892 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-45764ae5-e842-4773-bbc5-df3237b8765b tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c/os-volume_attachments/9153a431-81fa-4f4d-b244-d22c2076bd5b" status: 202 len: 0 microversion: 2.1 time: 0.178639 Jun 16 15:05:51.020667 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 510/1013] 10.222.0.72 () {58 vars in 1415 bytes} [Thu Jun 16 15:05:50 2022] DELETE /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c/os-volume_attachments/9153a431-81fa-4f4d-b244-d22c2076bd5b => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:05:51.029960 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-85dcefbe-9c4d-48f2-8597-4b170c085845 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:51.032085 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-85dcefbe-9c4d-48f2-8597-4b170c085845 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:51.039646 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85dcefbe-9c4d-48f2-8597-4b170c085845 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:51.040105 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85dcefbe-9c4d-48f2-8597-4b170c085845 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:51.041235 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85dcefbe-9c4d-48f2-8597-4b170c085845 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:51.041802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85dcefbe-9c4d-48f2-8597-4b170c085845 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:51.087044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-85dcefbe-9c4d-48f2-8597-4b170c085845 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061592 Jun 16 15:05:51.087605 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 504/1014] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:05:51 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:05:52.100376 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b91d7b0c-c0d9-4afb-8d36-8b1e693056b9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:52.101554 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b91d7b0c-c0d9-4afb-8d36-8b1e693056b9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:52.108901 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b91d7b0c-c0d9-4afb-8d36-8b1e693056b9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:52.109710 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b91d7b0c-c0d9-4afb-8d36-8b1e693056b9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:52.110765 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b91d7b0c-c0d9-4afb-8d36-8b1e693056b9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:52.111726 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b91d7b0c-c0d9-4afb-8d36-8b1e693056b9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:52.142827 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b91d7b0c-c0d9-4afb-8d36-8b1e693056b9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047595 Jun 16 15:05:52.143386 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 511/1015] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:05:52 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 15:05:52.231168 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-676b8138-4c08-4ccd-b072-2a3280b43378 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:52.232675 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-676b8138-4c08-4ccd-b072-2a3280b43378 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:52.240191 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-676b8138-4c08-4ccd-b072-2a3280b43378 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:52.240904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-676b8138-4c08-4ccd-b072-2a3280b43378 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:52.241808 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-676b8138-4c08-4ccd-b072-2a3280b43378 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:52.242613 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-676b8138-4c08-4ccd-b072-2a3280b43378 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:52.269067 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-676b8138-4c08-4ccd-b072-2a3280b43378 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:05:52.361248 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-676b8138-4c08-4ccd-b072-2a3280b43378 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "DELETE /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 204 len: 0 microversion: 2.1 time: 0.133893 Jun 16 15:05:52.362795 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 505/1016] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:05:52 2022] DELETE /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:05:52.371407 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6e32f542-b00f-468f-9d5d-083c40ab9aa9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:52.372269 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6e32f542-b00f-468f-9d5d-083c40ab9aa9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:52.378311 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e32f542-b00f-468f-9d5d-083c40ab9aa9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:52.378767 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e32f542-b00f-468f-9d5d-083c40ab9aa9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:52.379964 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e32f542-b00f-468f-9d5d-083c40ab9aa9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:52.380431 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e32f542-b00f-468f-9d5d-083c40ab9aa9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:52.621775 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6e32f542-b00f-468f-9d5d-083c40ab9aa9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:52.629216 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6e32f542-b00f-468f-9d5d-083c40ab9aa9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1690 microversion: 2.1 time: 0.262125 Jun 16 15:05:52.629782 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 512/1017] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:52 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1690 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:53.647495 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a888399b-dd64-4103-bf8d-6a4fd0e900e0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:53.648197 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a888399b-dd64-4103-bf8d-6a4fd0e900e0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:53.654559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a888399b-dd64-4103-bf8d-6a4fd0e900e0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:53.655239 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a888399b-dd64-4103-bf8d-6a4fd0e900e0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:53.656444 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a888399b-dd64-4103-bf8d-6a4fd0e900e0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:53.657197 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a888399b-dd64-4103-bf8d-6a4fd0e900e0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:53.889171 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a888399b-dd64-4103-bf8d-6a4fd0e900e0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:53.896611 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a888399b-dd64-4103-bf8d-6a4fd0e900e0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1690 microversion: 2.1 time: 0.253711 Jun 16 15:05:53.897204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 506/1018] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:53 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1690 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:54.914142 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e21e256e-e902-4b87-8d12-204f7edc75b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:54.914757 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e21e256e-e902-4b87-8d12-204f7edc75b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:54.921311 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e21e256e-e902-4b87-8d12-204f7edc75b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:54.921765 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e21e256e-e902-4b87-8d12-204f7edc75b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:54.922533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e21e256e-e902-4b87-8d12-204f7edc75b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:54.922970 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e21e256e-e902-4b87-8d12-204f7edc75b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:55.065170 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e21e256e-e902-4b87-8d12-204f7edc75b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:55.073077 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e21e256e-e902-4b87-8d12-204f7edc75b0 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1690 microversion: 2.1 time: 0.162767 Jun 16 15:05:55.078469 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 513/1019] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:54 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1690 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:56.094565 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-87620c7c-d536-495c-8989-b9d18cfb20f4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:56.095192 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-87620c7c-d536-495c-8989-b9d18cfb20f4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:56.101374 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87620c7c-d536-495c-8989-b9d18cfb20f4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:56.101824 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87620c7c-d536-495c-8989-b9d18cfb20f4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:56.102609 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87620c7c-d536-495c-8989-b9d18cfb20f4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:56.103012 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87620c7c-d536-495c-8989-b9d18cfb20f4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:56.389421 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-87620c7c-d536-495c-8989-b9d18cfb20f4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:56.398490 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-87620c7c-d536-495c-8989-b9d18cfb20f4 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1690 microversion: 2.1 time: 0.307595 Jun 16 15:05:56.399688 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 507/1020] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:56 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1690 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:57.265563 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-b2663a3e-959f-42a9-8eb5-3a235c03f537 req-96a8ba46-aa49-4a21-940d-f3d55ab95ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c", "name": "network-vif-deleted", "tag": "105d0fb0-e762-4bda-8533-5abf36bb8069"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:05:57.290365 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-b2663a3e-959f-42a9-8eb5-3a235c03f537 req-96a8ba46-aa49-4a21-940d-f3d55ab95ca9 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:57.291723 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-b2663a3e-959f-42a9-8eb5-3a235c03f537 req-96a8ba46-aa49-4a21-940d-f3d55ab95ca9 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:57.328701 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-b2663a3e-959f-42a9-8eb5-3a235c03f537 req-96a8ba46-aa49-4a21-940d-f3d55ab95ca9 service nova] Creating event network-vif-deleted:105d0fb0-e762-4bda-8533-5abf36bb8069 for instance 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c on hv-cinder-83716 Jun 16 15:05:57.346721 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-b2663a3e-959f-42a9-8eb5-3a235c03f537 req-96a8ba46-aa49-4a21-940d-f3d55ab95ca9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086095 Jun 16 15:05:57.348141 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 514/1021] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:05:57.415581 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-467ef0f8-3465-4515-b84b-df9a9315d705 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:57.416890 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-467ef0f8-3465-4515-b84b-df9a9315d705 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:57.424567 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-467ef0f8-3465-4515-b84b-df9a9315d705 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:57.425250 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-467ef0f8-3465-4515-b84b-df9a9315d705 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:57.426229 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-467ef0f8-3465-4515-b84b-df9a9315d705 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:57.426841 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-467ef0f8-3465-4515-b84b-df9a9315d705 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:57.484545 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-467ef0f8-3465-4515-b84b-df9a9315d705 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:57.487136 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-467ef0f8-3465-4515-b84b-df9a9315d705 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:57.487962 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-467ef0f8-3465-4515-b84b-df9a9315d705 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lazy-loading 'fault' on Instance uuid 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:05:57.538872 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-467ef0f8-3465-4515-b84b-df9a9315d705 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:05:57.553316 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-467ef0f8-3465-4515-b84b-df9a9315d705 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 200 len: 1335 microversion: 2.1 time: 0.141285 Jun 16 15:05:57.554610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 508/1022] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:57 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 1335 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:05:58.571434 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-51d526df-33ab-4970-b651-e1797a842171 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:58.572126 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-51d526df-33ab-4970-b651-e1797a842171 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:05:58.585821 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-51d526df-33ab-4970-b651-e1797a842171 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:58.586593 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-51d526df-33ab-4970-b651-e1797a842171 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:58.588768 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-51d526df-33ab-4970-b651-e1797a842171 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:05:58.589988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-51d526df-33ab-4970-b651-e1797a842171 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:05:58.605167 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-51d526df-33ab-4970-b651-e1797a842171 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] HTTP exception thrown: Instance 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c could not be found. Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-51d526df-33ab-4970-b651-e1797a842171 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Request method failure captured: Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c HTTP/1.1 Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0TVCnySq6CLsGu14_jXdA3WytN6REAzlZ9z0bzJWssteHdmInuzuZUdGNc86Ke3JhB3QF1B_ZB_UdLaErT_h4DfqeItC-W52HuLPerj8sPcNbz8-ulzFH1oOz92uhvmlKKusyUoKFDiEP5YG5vAvdfYGSrhS-nVsJMhPPp4r17NoIg Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: b017c2881aba4df6afe70cdcb84d5ee8 Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1574229167 Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 15:05:58.607148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 15:05:58.608903 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b017c2881aba4df6afe70cdcb84d5ee8", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b017c2881aba4df6afe70cdcb84d5ee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b017c2881aba4df6afe70cdcb84d5ee8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b017c2881aba4df6afe70cdcb84d5ee8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:05:58.608903 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1574229167 Jun 16 15:05:58.608903 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: b017c2881aba4df6afe70cdcb84d5ee8 Jun 16 15:05:58.608903 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1574229167 Jun 16 15:05:58.608903 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-ServerRescueNegativeTestJSON-1574229167-project Jun 16 15:05:58.608903 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 15:05:58.608903 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 15:05:58.608903 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: 73a51a4e876e4910bbc5dd69f8a18058 Jun 16 15:05:58.608903 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1574229167-project Jun 16 15:05:58.608903 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 15:05:58.608903 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c could not be found. Jun 16 15:05:58.608903 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': '3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c'} Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c could not be found. Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:05:58.609720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:05:58.611061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:05:58.611061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:05:58.611061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:05:58.611061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:05:58.611061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:05:58.611061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:05:58.611061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:05:58.611061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c could not be found. Jun 16 15:05:58.611061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:05:58.611061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:05:58.611061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:05:58.611061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:05:58.611061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:05:58.611061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:05:58.611061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:05:58.611061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:05:58.611061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c could not be found. Jun 16 15:05:58.611061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:05:58.612249 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-51d526df-33ab-4970-b651-e1797a842171 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Returning 404 to user: Instance 3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:05:58.612249 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-51d526df-33ab-4970-b651-e1797a842171 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c" status: 404 len: 111 microversion: 2.1 time: 0.041480 Jun 16 15:05:58.612249 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 515/1023] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:05:58 2022] GET /compute/v2.1/servers/3d2b6dfa-6a3e-4b72-93e8-1aefe2465d2c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:05:58.617843 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e405feb2-a9f0-4813-9caa-7cc31e763594 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '.version_select at 0x7faab63650d0>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:05:58.637621 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e405feb2-a9f0-4813-9caa-7cc31e763594 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1272369815" status: 202 len: 0 microversion: 2.1 time: 0.023646 Jun 16 15:05:58.638191 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 509/1024] 10.222.0.72 () {58 vars in 1220 bytes} [Thu Jun 16 15:05:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1272369815 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:06:01.473213 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9209ac9c-8e62-400f-b026-1798e50adfab tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:01.473705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9209ac9c-8e62-400f-b026-1798e50adfab tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:01.480207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9209ac9c-8e62-400f-b026-1798e50adfab tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:01.480644 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9209ac9c-8e62-400f-b026-1798e50adfab tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:01.481418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9209ac9c-8e62-400f-b026-1798e50adfab tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:01.481846 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9209ac9c-8e62-400f-b026-1798e50adfab tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:01.506192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9209ac9c-8e62-400f-b026-1798e50adfab tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:06:01.578964 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9209ac9c-8e62-400f-b026-1798e50adfab tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "DELETE /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 204 len: 0 microversion: 2.1 time: 0.109273 Jun 16 15:06:01.579536 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 516/1025] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:06:01 2022] DELETE /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:06:01.588485 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e5e8d42d-cff9-4b8d-8243-7e089152d8d6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:01.589726 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e5e8d42d-cff9-4b8d-8243-7e089152d8d6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:01.596087 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e5e8d42d-cff9-4b8d-8243-7e089152d8d6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:01.596540 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e5e8d42d-cff9-4b8d-8243-7e089152d8d6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:01.597350 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e5e8d42d-cff9-4b8d-8243-7e089152d8d6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:01.597791 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e5e8d42d-cff9-4b8d-8243-7e089152d8d6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:01.967164 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e5e8d42d-cff9-4b8d-8243-7e089152d8d6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:01.974644 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e5e8d42d-cff9-4b8d-8243-7e089152d8d6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1508 microversion: 2.1 time: 0.390937 Jun 16 15:06:01.975194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 510/1026] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:01 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1508 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:02.992061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-83f4dca6-d0fb-4bb8-8a8e-dd408f46b90e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:02.992673 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-83f4dca6-d0fb-4bb8-8a8e-dd408f46b90e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:02.999162 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-83f4dca6-d0fb-4bb8-8a8e-dd408f46b90e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:02.999673 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-83f4dca6-d0fb-4bb8-8a8e-dd408f46b90e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:03.000435 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-83f4dca6-d0fb-4bb8-8a8e-dd408f46b90e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:03.000883 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-83f4dca6-d0fb-4bb8-8a8e-dd408f46b90e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:03.142899 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-83f4dca6-d0fb-4bb8-8a8e-dd408f46b90e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:03.153349 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-8b29f9d7-7ef3-4fab-93e1-91fba79bbd0f req-b84fd18b-3024-4f4b-b887-3bcefc84185c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "129cdf3c-4878-4058-9cb3-a2d36be40174", "name": "network-vif-deleted", "tag": "dc9a5426-4d1e-4bfb-b195-628a512c0bf9"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:06:03.162997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-83f4dca6-d0fb-4bb8-8a8e-dd408f46b90e tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 200 len: 1508 microversion: 2.1 time: 0.175104 Jun 16 15:06:03.163584 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 517/1027] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:02 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:03.172241 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-8b29f9d7-7ef3-4fab-93e1-91fba79bbd0f req-b84fd18b-3024-4f4b-b887-3bcefc84185c service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:03.173036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-8b29f9d7-7ef3-4fab-93e1-91fba79bbd0f req-b84fd18b-3024-4f4b-b887-3bcefc84185c service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:03.186416 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-8b29f9d7-7ef3-4fab-93e1-91fba79bbd0f req-b84fd18b-3024-4f4b-b887-3bcefc84185c service nova] Creating event network-vif-deleted:dc9a5426-4d1e-4bfb-b195-628a512c0bf9 for instance 129cdf3c-4878-4058-9cb3-a2d36be40174 on hv-cinder-83716 Jun 16 15:06:03.193549 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-8b29f9d7-7ef3-4fab-93e1-91fba79bbd0f req-b84fd18b-3024-4f4b-b887-3bcefc84185c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044898 Jun 16 15:06:03.194247 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 511/1028] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:06:04.180800 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ba2d59f8-2932-4524-8a88-539d65b44e84 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:04.181487 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ba2d59f8-2932-4524-8a88-539d65b44e84 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 129cdf3c-4878-4058-9cb3-a2d36be40174] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:04.188222 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ba2d59f8-2932-4524-8a88-539d65b44e84 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:04.188667 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ba2d59f8-2932-4524-8a88-539d65b44e84 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:04.189451 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ba2d59f8-2932-4524-8a88-539d65b44e84 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:04.189885 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ba2d59f8-2932-4524-8a88-539d65b44e84 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:04.203843 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-ba2d59f8-2932-4524-8a88-539d65b44e84 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] HTTP exception thrown: Instance 129cdf3c-4878-4058-9cb3-a2d36be40174 could not be found. Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ba2d59f8-2932-4524-8a88-539d65b44e84 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Request method failure captured: Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 HTTP/1.1 Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0TVCnySq6CLsGu14_jXdA3WytN6REAzlZ9z0bzJWssteHdmInuzuZUdGNc86Ke3JhB3QF1B_ZB_UdLaErT_h4DfqeItC-W52HuLPerj8sPcNbz8-ulzFH1oOz92uhvmlKKusyUoKFDiEP5YG5vAvdfYGSrhS-nVsJMhPPp4r17NoIg Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: b017c2881aba4df6afe70cdcb84d5ee8 Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1574229167 Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 15:06:04.205491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 15:06:04.206902 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b017c2881aba4df6afe70cdcb84d5ee8", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b017c2881aba4df6afe70cdcb84d5ee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b017c2881aba4df6afe70cdcb84d5ee8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b017c2881aba4df6afe70cdcb84d5ee8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:06:04.206902 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1574229167 Jun 16 15:06:04.206902 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: b017c2881aba4df6afe70cdcb84d5ee8 Jun 16 15:06:04.206902 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1574229167 Jun 16 15:06:04.206902 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-ServerRescueNegativeTestJSON-1574229167-project Jun 16 15:06:04.206902 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 15:06:04.206902 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 15:06:04.206902 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: 73a51a4e876e4910bbc5dd69f8a18058 Jun 16 15:06:04.206902 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1574229167-project Jun 16 15:06:04.206902 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 15:06:04.206902 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance 129cdf3c-4878-4058-9cb3-a2d36be40174 could not be found. Jun 16 15:06:04.206902 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': '129cdf3c-4878-4058-9cb3-a2d36be40174'} Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 129cdf3c-4878-4058-9cb3-a2d36be40174 could not be found. Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:06:04.207633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:06:04.209204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:06:04.209204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:06:04.209204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:06:04.209204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:06:04.209204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:06:04.209204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:06:04.209204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:06:04.209204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 129cdf3c-4878-4058-9cb3-a2d36be40174 could not be found. Jun 16 15:06:04.209204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:06:04.209204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:06:04.209204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:06:04.209204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:06:04.209204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:06:04.209204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:06:04.209204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:06:04.209204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:06:04.209204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 129cdf3c-4878-4058-9cb3-a2d36be40174 could not be found. Jun 16 15:06:04.209204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:06:04.210679 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ba2d59f8-2932-4524-8a88-539d65b44e84 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Returning 404 to user: Instance 129cdf3c-4878-4058-9cb3-a2d36be40174 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:06:04.210679 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ba2d59f8-2932-4524-8a88-539d65b44e84 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174" status: 404 len: 111 microversion: 2.1 time: 0.030032 Jun 16 15:06:04.210679 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 518/1029] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:04 2022] GET /compute/v2.1/servers/129cdf3c-4878-4058-9cb3-a2d36be40174 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:06:04.216456 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-431d5390-d279-4a73-a6f7-75dbd9d981a6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:04.217071 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-431d5390-d279-4a73-a6f7-75dbd9d981a6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:04.223302 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-431d5390-d279-4a73-a6f7-75dbd9d981a6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:04.223760 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-431d5390-d279-4a73-a6f7-75dbd9d981a6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:04.224524 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-431d5390-d279-4a73-a6f7-75dbd9d981a6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:04.224996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-431d5390-d279-4a73-a6f7-75dbd9d981a6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:04.242452 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:04.251250 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-431d5390-d279-4a73-a6f7-75dbd9d981a6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:06:04.326517 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-431d5390-d279-4a73-a6f7-75dbd9d981a6 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "DELETE /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 204 len: 0 microversion: 2.1 time: 0.114449 Jun 16 15:06:04.327106 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 512/1030] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:06:04 2022] DELETE /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:06:04.335370 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2cf1c4cb-f596-4ae6-a8b2-5d25083d1eee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:04.335978 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2cf1c4cb-f596-4ae6-a8b2-5d25083d1eee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:04.342677 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2cf1c4cb-f596-4ae6-a8b2-5d25083d1eee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:04.343131 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2cf1c4cb-f596-4ae6-a8b2-5d25083d1eee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:04.343997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2cf1c4cb-f596-4ae6-a8b2-5d25083d1eee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:04.344440 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2cf1c4cb-f596-4ae6-a8b2-5d25083d1eee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:04.348492 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:04.473955 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2cf1c4cb-f596-4ae6-a8b2-5d25083d1eee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:04.481330 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2cf1c4cb-f596-4ae6-a8b2-5d25083d1eee tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.149807 Jun 16 15:06:04.481884 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 519/1031] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:04 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:06:05.500725 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e6c248b7-a191-4d05-ad22-47dbaec6e524 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:05.501521 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e6c248b7-a191-4d05-ad22-47dbaec6e524 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:05.508461 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6c248b7-a191-4d05-ad22-47dbaec6e524 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:05.508944 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6c248b7-a191-4d05-ad22-47dbaec6e524 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:05.510174 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6c248b7-a191-4d05-ad22-47dbaec6e524 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:05.511192 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6c248b7-a191-4d05-ad22-47dbaec6e524 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:05.734283 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e6c248b7-a191-4d05-ad22-47dbaec6e524 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73a51a4e876e4910bbc5dd69f8a18058', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b017c2881aba4df6afe70cdcb84d5ee8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:05.741925 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e6c248b7-a191-4d05-ad22-47dbaec6e524 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 200 len: 1521 microversion: 2.1 time: 0.247257 Jun 16 15:06:05.742491 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 513/1032] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:05 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:06.034263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-c5832d6b-bc72-4687-a2b1-b3015e2a058c req-9017f64d-4bcd-4c16-a003-b66ac3104f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822acf52-490b-49b9-b85f-db02cc41a0bf", "name": "network-vif-deleted", "tag": "63cdf77a-1418-4eaf-8ecb-70cb8c2c86ac"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:06:06.043360 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-c5832d6b-bc72-4687-a2b1-b3015e2a058c req-9017f64d-4bcd-4c16-a003-b66ac3104f49 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:06.043808 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-c5832d6b-bc72-4687-a2b1-b3015e2a058c req-9017f64d-4bcd-4c16-a003-b66ac3104f49 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:06.055247 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-c5832d6b-bc72-4687-a2b1-b3015e2a058c req-9017f64d-4bcd-4c16-a003-b66ac3104f49 service nova] Creating event network-vif-deleted:63cdf77a-1418-4eaf-8ecb-70cb8c2c86ac for instance 822acf52-490b-49b9-b85f-db02cc41a0bf on hv-cinder-83716 Jun 16 15:06:06.060879 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-c5832d6b-bc72-4687-a2b1-b3015e2a058c req-9017f64d-4bcd-4c16-a003-b66ac3104f49 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030780 Jun 16 15:06:06.061850 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 520/1033] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:06:06.758710 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-822563ac-54fb-4b34-ab28-fde4daa063a9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:06.759280 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-822563ac-54fb-4b34-ab28-fde4daa063a9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] [instance: 822acf52-490b-49b9-b85f-db02cc41a0bf] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:06.766415 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-822563ac-54fb-4b34-ab28-fde4daa063a9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:06.766876 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-822563ac-54fb-4b34-ab28-fde4daa063a9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:06.767676 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-822563ac-54fb-4b34-ab28-fde4daa063a9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:06.768122 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-822563ac-54fb-4b34-ab28-fde4daa063a9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:06.782247 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-822563ac-54fb-4b34-ab28-fde4daa063a9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] HTTP exception thrown: Instance 822acf52-490b-49b9-b85f-db02cc41a0bf could not be found. Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-822563ac-54fb-4b34-ab28-fde4daa063a9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Request method failure captured: Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf HTTP/1.1 Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TVCnySq6CLsGu14_jXdA3WytN6REAzlZ9z0bzJWssteHdmInuzuZUdGNc86Ke3JhB3QF1B_ZB_UdLaErT_h4DfqeItC-W52HuLPerj8sPcNbz8-ulzFH1oOz92uhvmlKKusyUoKFDiEP5YG5vAvdfYGSrhS-nVsJMhPPp4r17NoIg Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: b017c2881aba4df6afe70cdcb84d5ee8 Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1574229167 Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:06:06.783880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:06:06.785496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_b017c2881aba4df6afe70cdcb84d5ee8", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b017c2881aba4df6afe70cdcb84d5ee8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/b017c2881aba4df6afe70cdcb84d5ee8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/b017c2881aba4df6afe70cdcb84d5ee8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:06:06.785496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1574229167 Jun 16 15:06:06.785496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: b017c2881aba4df6afe70cdcb84d5ee8 Jun 16 15:06:06.785496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1574229167 Jun 16 15:06:06.785496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-ServerRescueNegativeTestJSON-1574229167-project Jun 16 15:06:06.785496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:06:06.785496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:06:06.785496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 73a51a4e876e4910bbc5dd69f8a18058 Jun 16 15:06:06.785496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1574229167-project Jun 16 15:06:06.785496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:06:06.785496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance 822acf52-490b-49b9-b85f-db02cc41a0bf could not be found. Jun 16 15:06:06.785496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': '822acf52-490b-49b9-b85f-db02cc41a0bf'} Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 822acf52-490b-49b9-b85f-db02cc41a0bf could not be found. Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:06:06.786376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:06:06.787816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:06:06.787816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:06:06.787816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:06:06.787816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:06:06.787816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:06:06.787816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:06:06.787816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:06:06.787816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 822acf52-490b-49b9-b85f-db02cc41a0bf could not be found. Jun 16 15:06:06.787816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:06:06.787816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:06:06.787816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:06:06.787816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:06:06.787816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:06:06.787816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:06:06.787816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:06:06.787816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:06:06.787816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 822acf52-490b-49b9-b85f-db02cc41a0bf could not be found. Jun 16 15:06:06.787816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:06:06.789144 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-822563ac-54fb-4b34-ab28-fde4daa063a9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] Returning 404 to user: Instance 822acf52-490b-49b9-b85f-db02cc41a0bf could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:06:06.789144 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-822563ac-54fb-4b34-ab28-fde4daa063a9 tempest-ServerRescueNegativeTestJSON-1574229167 tempest-ServerRescueNegativeTestJSON-1574229167-project] 10.222.0.72 "GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf" status: 404 len: 111 microversion: 2.1 time: 0.030558 Jun 16 15:06:06.789144 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 514/1034] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:06 2022] GET /compute/v2.1/servers/822acf52-490b-49b9-b85f-db02cc41a0bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:06:17.272239 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:17.273151 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=6 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:17.277271 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-090e72af-471b-4921-9701-0e54542b2757 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:17.278266 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-090e72af-471b-4921-9701-0e54542b2757 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:17.285835 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-090e72af-471b-4921-9701-0e54542b2757 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:17.286282 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-090e72af-471b-4921-9701-0e54542b2757 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:17.287037 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-090e72af-471b-4921-9701-0e54542b2757 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:17.287467 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-090e72af-471b-4921-9701-0e54542b2757 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:17.316521 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-090e72af-471b-4921-9701-0e54542b2757 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045877 Jun 16 15:06:17.317085 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 521/1035] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:06:17 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 15:06:17.373693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e38be192-5cda-489d-a183-ea565953e490 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:17.374197 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e38be192-5cda-489d-a183-ea565953e490 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:17.376858 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:17.377645 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:17.384503 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e38be192-5cda-489d-a183-ea565953e490 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:17.385003 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e38be192-5cda-489d-a183-ea565953e490 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:17.385806 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e38be192-5cda-489d-a183-ea565953e490 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:17.386282 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e38be192-5cda-489d-a183-ea565953e490 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:17.413830 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e38be192-5cda-489d-a183-ea565953e490 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:06:17.492624 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e38be192-5cda-489d-a183-ea565953e490 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "DELETE /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 204 len: 0 microversion: 2.1 time: 0.122929 Jun 16 15:06:17.493298 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 515/1036] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:06:17 2022] DELETE /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:06:17.503080 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-03bc0fd7-419c-452c-9484-8a2eefcd98a9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:17.503676 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-03bc0fd7-419c-452c-9484-8a2eefcd98a9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:17.510179 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-03bc0fd7-419c-452c-9484-8a2eefcd98a9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:17.510659 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-03bc0fd7-419c-452c-9484-8a2eefcd98a9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:17.511419 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-03bc0fd7-419c-452c-9484-8a2eefcd98a9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:17.511894 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-03bc0fd7-419c-452c-9484-8a2eefcd98a9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:17.648903 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-03bc0fd7-419c-452c-9484-8a2eefcd98a9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:17.657127 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-03bc0fd7-419c-452c-9484-8a2eefcd98a9 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1672 microversion: 2.1 time: 0.157840 Jun 16 15:06:17.657783 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 522/1037] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:17 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:18.675140 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-188cdc14-49be-4e45-81bf-339e36e7d77b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:18.675761 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-188cdc14-49be-4e45-81bf-339e36e7d77b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:18.682894 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-188cdc14-49be-4e45-81bf-339e36e7d77b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:18.683351 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-188cdc14-49be-4e45-81bf-339e36e7d77b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:18.684116 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-188cdc14-49be-4e45-81bf-339e36e7d77b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:18.684558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-188cdc14-49be-4e45-81bf-339e36e7d77b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:18.813232 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-188cdc14-49be-4e45-81bf-339e36e7d77b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:18.820723 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-188cdc14-49be-4e45-81bf-339e36e7d77b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1672 microversion: 2.1 time: 0.149969 Jun 16 15:06:18.821310 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 516/1038] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:18 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:19.836795 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b8154792-8de5-42f2-be60-255ae0e6b72a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:19.838056 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b8154792-8de5-42f2-be60-255ae0e6b72a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:19.846158 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b8154792-8de5-42f2-be60-255ae0e6b72a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:19.846698 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b8154792-8de5-42f2-be60-255ae0e6b72a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:19.848076 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b8154792-8de5-42f2-be60-255ae0e6b72a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:19.848076 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b8154792-8de5-42f2-be60-255ae0e6b72a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:19.937911 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-e6d0a731-405d-4847-88ce-5740290908df req-61986876-25e5-4e72-98c4-3853616e1a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34992108-bb48-4184-88ee-43907b8b14a3", "name": "network-vif-deleted", "tag": "debe1ea3-86a2-4afa-9cc5-933e034bfa9d"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:06:19.951239 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-e6d0a731-405d-4847-88ce-5740290908df req-61986876-25e5-4e72-98c4-3853616e1a24 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:19.951998 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-e6d0a731-405d-4847-88ce-5740290908df req-61986876-25e5-4e72-98c4-3853616e1a24 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:19.966887 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-e6d0a731-405d-4847-88ce-5740290908df req-61986876-25e5-4e72-98c4-3853616e1a24 service nova] Creating event network-vif-deleted:debe1ea3-86a2-4afa-9cc5-933e034bfa9d for instance 34992108-bb48-4184-88ee-43907b8b14a3 on hv-cinder-83716 Jun 16 15:06:19.971629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-e6d0a731-405d-4847-88ce-5740290908df req-61986876-25e5-4e72-98c4-3853616e1a24 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037369 Jun 16 15:06:19.972892 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 517/1039] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:06:19.983490 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b8154792-8de5-42f2-be60-255ae0e6b72a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:19.996097 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b8154792-8de5-42f2-be60-255ae0e6b72a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 200 len: 1605 microversion: 2.1 time: 0.163041 Jun 16 15:06:19.998264 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 523/1040] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:19 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 1605 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:21.021337 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-545b3f03-e0b1-4551-89fc-9f42a25fa6a8 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:21.028113 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-545b3f03-e0b1-4551-89fc-9f42a25fa6a8 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:21.035294 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-545b3f03-e0b1-4551-89fc-9f42a25fa6a8 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:21.035744 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-545b3f03-e0b1-4551-89fc-9f42a25fa6a8 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:21.036513 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-545b3f03-e0b1-4551-89fc-9f42a25fa6a8 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:21.036986 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-545b3f03-e0b1-4551-89fc-9f42a25fa6a8 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:21.053490 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-545b3f03-e0b1-4551-89fc-9f42a25fa6a8 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] HTTP exception thrown: Instance 34992108-bb48-4184-88ee-43907b8b14a3 could not be found. Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-545b3f03-e0b1-4551-89fc-9f42a25fa6a8 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Request method failure captured: Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 HTTP/1.1 Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0VWj1cLhR6dixZorVVjO56wH6fMR0eG_PnQ0i6paR4ytJ0P6tqtt_PpXAlgqyXceuBnCFw4egx41E2FUI8eryVn_vNkMKb3uGme4hfWAhyJvVUn-8Rj1e-Zv4pORz8GnKsdT_vPtt00QkGDmBL1Jd8ABHWl1Q6_Z06J02d_hdDL4es Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 3c94142f5fe543e28710c9bb2916662c Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeTestJSON-1611970277 Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:06:21.056292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:06:21.057988 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3c94142f5fe543e28710c9bb2916662c", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c94142f5fe543e28710c9bb2916662c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c94142f5fe543e28710c9bb2916662c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3c94142f5fe543e28710c9bb2916662c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:06:21.057988 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeTestJSON-1611970277 Jun 16 15:06:21.057988 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 3c94142f5fe543e28710c9bb2916662c Jun 16 15:06:21.057988 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1611970277 Jun 16 15:06:21.057988 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeTestJSON-1611970277-project Jun 16 15:06:21.057988 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:06:21.057988 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:06:21.057988 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: b424792631ac40f48c3f3c1529d699b3 Jun 16 15:06:21.057988 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeTestJSON-1611970277-project Jun 16 15:06:21.057988 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:06:21.057988 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance 34992108-bb48-4184-88ee-43907b8b14a3 could not be found. Jun 16 15:06:21.057988 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': '34992108-bb48-4184-88ee-43907b8b14a3'} Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34992108-bb48-4184-88ee-43907b8b14a3 could not be found. Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:06:21.058882 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:06:21.060292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:06:21.060292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:06:21.060292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:06:21.060292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:06:21.060292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:06:21.060292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:06:21.060292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:06:21.060292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34992108-bb48-4184-88ee-43907b8b14a3 could not be found. Jun 16 15:06:21.060292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:06:21.060292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:06:21.060292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:06:21.060292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:06:21.060292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:06:21.060292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:06:21.060292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:06:21.060292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:06:21.060292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34992108-bb48-4184-88ee-43907b8b14a3 could not be found. Jun 16 15:06:21.060292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:06:21.062220 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-545b3f03-e0b1-4551-89fc-9f42a25fa6a8 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Returning 404 to user: Instance 34992108-bb48-4184-88ee-43907b8b14a3 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:06:21.063241 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-545b3f03-e0b1-4551-89fc-9f42a25fa6a8 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 404 len: 111 microversion: 2.1 time: 0.050994 Jun 16 15:06:21.063785 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 518/1041] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:21 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:06:21.075241 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-338e2e8e-4bd2-44fe-8877-f3646beb556f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '.version_select at 0x7faab5e50af0>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:21.093697 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-338e2e8e-4bd2-44fe-8877-f3646beb556f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-104338804" status: 202 len: 0 microversion: 2.1 time: 0.023370 Jun 16 15:06:21.094658 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 524/1042] 10.222.0.72 () {58 vars in 1217 bytes} [Thu Jun 16 15:06:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-104338804 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:06:21.746981 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8db0d891-4acb-4f68-b446-2a023ee0c7ac tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Action: 'create', calling method: .version_select at 0x7faab62aeca0>, body: {"keypair": {"name": "tempest-keypair-794601268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDtO3mWpXfGED59dg0rVT9b6m/gM2gEEk1mkvYAJna2MbXKBg+WyDu+Jgfx25s8oEkk19qqdup0MmVA/sK9x/2FxXQHY5w/2xsh8WeJgt6Xwz9q7irY8m5zVDwgVa4tzGg=="}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:06:21.761197 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-8db0d891-4acb-4f68-b446-2a023ee0c7ac tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Getting quotas for project 3c94142f5fe543e28710c9bb2916662c. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:06:21.765486 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-8db0d891-4acb-4f68-b446-2a023ee0c7ac tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Getting quotas for user b424792631ac40f48c3f3c1529d699b3 and project 3c94142f5fe543e28710c9bb2916662c. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:06:21.789422 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8db0d891-4acb-4f68-b446-2a023ee0c7ac tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046263 Jun 16 15:06:21.790215 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 519/1043] 10.222.0.72 () {60 vars in 1158 bytes} [Thu Jun 16 15:06:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:06:23.109366 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d994e1b0-1801-48ee-b7b7-b333a1787f84 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1063590557", "imageRef": "23371504-a4d6-4064-90b4-87bfd0a15170", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e965c323-79ff-4b11-8aaa-a2df835467d6"}], "security_groups": [{"name": "tempest-securitygroup--1382095008"}], "key_name": "tempest-keypair-794601268", "user_data": "}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:06:23.210415 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.network.neutron [None req-d994e1b0-1801-48ee-b7b7-b333a1787f84 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] validate_networks() for [('e965c323-79ff-4b11-8aaa-a2df835467d6', None, None, None, None, None)] {{(pid=124589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:06:23.575178 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-d994e1b0-1801-48ee-b7b7-b333a1787f84 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Flavor limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:06:23.575607 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-d994e1b0-1801-48ee-b7b7-b333a1787f84 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Image limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:06:23.576077 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-d994e1b0-1801-48ee-b7b7-b333a1787f84 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Flavor pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:06:23.576492 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-d994e1b0-1801-48ee-b7b7-b333a1787f84 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Image pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:06:23.576965 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-d994e1b0-1801-48ee-b7b7-b333a1787f84 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:06:23.586108 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d994e1b0-1801-48ee-b7b7-b333a1787f84 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:23.586567 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d994e1b0-1801-48ee-b7b7-b333a1787f84 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:23.587362 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d994e1b0-1801-48ee-b7b7-b333a1787f84 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:23.587806 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d994e1b0-1801-48ee-b7b7-b333a1787f84 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:23.605511 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-d994e1b0-1801-48ee-b7b7-b333a1787f84 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Getting quotas for project 3c94142f5fe543e28710c9bb2916662c. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:06:23.609457 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-d994e1b0-1801-48ee-b7b7-b333a1787f84 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Getting quotas for user b424792631ac40f48c3f3c1529d699b3 and project 3c94142f5fe543e28710c9bb2916662c. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:06:23.620559 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d994e1b0-1801-48ee-b7b7-b333a1787f84 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Going to run 1 instances... {{(pid=124589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:06:23.622823 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d994e1b0-1801-48ee-b7b7-b333a1787f84 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23371504-a4d6-4064-90b4-87bfd0a15170',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:06:23.669171 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d994e1b0-1801-48ee-b7b7-b333a1787f84 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.564709 Jun 16 15:06:23.669745 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 525/1044] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 15:06:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 15:06:23.679664 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-185393c3-ff37-4506-9a2f-22994ef5da54 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:23.680404 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-185393c3-ff37-4506-9a2f-22994ef5da54 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:23.738810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-185393c3-ff37-4506-9a2f-22994ef5da54 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:23.745751 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-185393c3-ff37-4506-9a2f-22994ef5da54 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 200 len: 1237 microversion: 2.1 time: 0.069938 Jun 16 15:06:23.746584 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 520/1045] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:23 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:24.763905 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0f016089-ae43-4021-ab78-c7af56fbef79 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:24.765297 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0f016089-ae43-4021-ab78-c7af56fbef79 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:24.772782 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f016089-ae43-4021-ab78-c7af56fbef79 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:24.773575 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f016089-ae43-4021-ab78-c7af56fbef79 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:24.774746 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f016089-ae43-4021-ab78-c7af56fbef79 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:24.775395 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f016089-ae43-4021-ab78-c7af56fbef79 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:24.839121 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0f016089-ae43-4021-ab78-c7af56fbef79 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:24.846444 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0f016089-ae43-4021-ab78-c7af56fbef79 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 200 len: 1307 microversion: 2.1 time: 0.087490 Jun 16 15:06:24.847015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 526/1046] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:24 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 1307 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:25.863457 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d7db99dc-fec7-413d-a0ca-4ca9201f1a7a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:25.864070 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d7db99dc-fec7-413d-a0ca-4ca9201f1a7a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:25.870748 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7db99dc-fec7-413d-a0ca-4ca9201f1a7a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:25.871207 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7db99dc-fec7-413d-a0ca-4ca9201f1a7a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:25.871972 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7db99dc-fec7-413d-a0ca-4ca9201f1a7a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:25.872416 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7db99dc-fec7-413d-a0ca-4ca9201f1a7a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:25.937198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d7db99dc-fec7-413d-a0ca-4ca9201f1a7a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:25.945176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d7db99dc-fec7-413d-a0ca-4ca9201f1a7a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 200 len: 1295 microversion: 2.1 time: 0.085639 Jun 16 15:06:25.945740 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 521/1047] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:25 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 1295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:26.962607 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f74ef732-f729-4d12-80fe-3c7feb8fbde5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:26.963761 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f74ef732-f729-4d12-80fe-3c7feb8fbde5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:26.970304 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f74ef732-f729-4d12-80fe-3c7feb8fbde5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:26.970745 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f74ef732-f729-4d12-80fe-3c7feb8fbde5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:26.971492 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f74ef732-f729-4d12-80fe-3c7feb8fbde5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:26.971921 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f74ef732-f729-4d12-80fe-3c7feb8fbde5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:27.033474 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f74ef732-f729-4d12-80fe-3c7feb8fbde5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:27.040854 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f74ef732-f729-4d12-80fe-3c7feb8fbde5 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 200 len: 1295 microversion: 2.1 time: 0.082047 Jun 16 15:06:27.041489 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 527/1048] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:26 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 1295 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:28.058484 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6bc6abe7-253c-49ec-a205-62183b49fef7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:28.059092 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6bc6abe7-253c-49ec-a205-62183b49fef7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:28.065628 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6bc6abe7-253c-49ec-a205-62183b49fef7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:28.066075 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6bc6abe7-253c-49ec-a205-62183b49fef7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:28.066831 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6bc6abe7-253c-49ec-a205-62183b49fef7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:28.067260 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6bc6abe7-253c-49ec-a205-62183b49fef7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:28.131072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6bc6abe7-253c-49ec-a205-62183b49fef7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:28.139074 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6bc6abe7-253c-49ec-a205-62183b49fef7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 200 len: 1295 microversion: 2.1 time: 0.085290 Jun 16 15:06:28.139561 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 522/1049] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:28 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 1295 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:29.155936 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-de3b96a4-a4af-41be-a3fc-63f986f47307 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:29.156861 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-de3b96a4-a4af-41be-a3fc-63f986f47307 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:29.173939 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de3b96a4-a4af-41be-a3fc-63f986f47307 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:29.174306 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de3b96a4-a4af-41be-a3fc-63f986f47307 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:29.175112 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de3b96a4-a4af-41be-a3fc-63f986f47307 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:29.175553 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de3b96a4-a4af-41be-a3fc-63f986f47307 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:29.317157 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-de3b96a4-a4af-41be-a3fc-63f986f47307 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:29.324770 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-de3b96a4-a4af-41be-a3fc-63f986f47307 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 200 len: 1363 microversion: 2.1 time: 0.172645 Jun 16 15:06:29.325436 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 528/1050] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:29 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:29.616098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-cce62f39-6d32-4e93-a24e-0d129d7074d2 req-3fe9c15b-5bc9-466d-a8f7-1d4e1e406259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc", "tag": "91200d16-5dc6-4b76-856c-ee259b54b7b7"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:06:29.634339 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-cce62f39-6d32-4e93-a24e-0d129d7074d2 req-3fe9c15b-5bc9-466d-a8f7-1d4e1e406259 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:29.634781 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-cce62f39-6d32-4e93-a24e-0d129d7074d2 req-3fe9c15b-5bc9-466d-a8f7-1d4e1e406259 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:29.650363 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-cce62f39-6d32-4e93-a24e-0d129d7074d2 req-3fe9c15b-5bc9-466d-a8f7-1d4e1e406259 service nova] Creating event network-changed:91200d16-5dc6-4b76-856c-ee259b54b7b7 for instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc on hv-cinder-83716 Jun 16 15:06:29.657984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-cce62f39-6d32-4e93-a24e-0d129d7074d2 req-3fe9c15b-5bc9-466d-a8f7-1d4e1e406259 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045127 Jun 16 15:06:29.658921 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 523/1051] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:06:30.341671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0bd1a874-34dc-4959-8270-37d9d9904b6f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:30.342281 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0bd1a874-34dc-4959-8270-37d9d9904b6f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:30.348795 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0bd1a874-34dc-4959-8270-37d9d9904b6f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:30.349275 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0bd1a874-34dc-4959-8270-37d9d9904b6f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:30.350040 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0bd1a874-34dc-4959-8270-37d9d9904b6f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:30.350482 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0bd1a874-34dc-4959-8270-37d9d9904b6f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:30.477135 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0bd1a874-34dc-4959-8270-37d9d9904b6f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:30.484469 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0bd1a874-34dc-4959-8270-37d9d9904b6f tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 200 len: 1363 microversion: 2.1 time: 0.146775 Jun 16 15:06:30.485061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 529/1052] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:30 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:31.502163 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-20baa1d2-9cbc-4bd7-9589-270f190b0c6d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:31.502862 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-20baa1d2-9cbc-4bd7-9589-270f190b0c6d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:31.509103 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-20baa1d2-9cbc-4bd7-9589-270f190b0c6d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:31.509559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-20baa1d2-9cbc-4bd7-9589-270f190b0c6d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:31.510836 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-20baa1d2-9cbc-4bd7-9589-270f190b0c6d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:31.511277 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-20baa1d2-9cbc-4bd7-9589-270f190b0c6d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:31.643365 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-20baa1d2-9cbc-4bd7-9589-270f190b0c6d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:31.651387 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-20baa1d2-9cbc-4bd7-9589-270f190b0c6d tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 200 len: 1363 microversion: 2.1 time: 0.153373 Jun 16 15:06:31.651938 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 524/1053] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:31 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:32.667366 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8a9ff576-ec45-4367-89b6-f44968c17d56 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:32.667968 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8a9ff576-ec45-4367-89b6-f44968c17d56 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:32.674431 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a9ff576-ec45-4367-89b6-f44968c17d56 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:32.674882 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a9ff576-ec45-4367-89b6-f44968c17d56 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:32.675711 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a9ff576-ec45-4367-89b6-f44968c17d56 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:32.676145 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a9ff576-ec45-4367-89b6-f44968c17d56 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:32.810026 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8a9ff576-ec45-4367-89b6-f44968c17d56 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:32.821153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8a9ff576-ec45-4367-89b6-f44968c17d56 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 200 len: 1363 microversion: 2.1 time: 0.157407 Jun 16 15:06:32.827680 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 530/1054] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:32 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:33.838464 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-eba314cf-dad7-47e1-82e3-2753c0093d23 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:33.839162 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-eba314cf-dad7-47e1-82e3-2753c0093d23 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:33.841658 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=6 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:33.847003 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eba314cf-dad7-47e1-82e3-2753c0093d23 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:33.847459 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eba314cf-dad7-47e1-82e3-2753c0093d23 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:33.848226 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eba314cf-dad7-47e1-82e3-2753c0093d23 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:33.848666 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eba314cf-dad7-47e1-82e3-2753c0093d23 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:33.989141 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-eba314cf-dad7-47e1-82e3-2753c0093d23 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:33.998916 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-eba314cf-dad7-47e1-82e3-2753c0093d23 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 200 len: 1363 microversion: 2.1 time: 0.164249 Jun 16 15:06:33.999727 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 525/1055] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:33 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:35.016880 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fa7329fa-56f8-4c6c-92eb-07c7366f16eb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:35.017641 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fa7329fa-56f8-4c6c-92eb-07c7366f16eb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:35.020331 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:35.021042 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=6 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:35.028449 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa7329fa-56f8-4c6c-92eb-07c7366f16eb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:35.029001 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa7329fa-56f8-4c6c-92eb-07c7366f16eb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:35.030083 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa7329fa-56f8-4c6c-92eb-07c7366f16eb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:35.030745 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa7329fa-56f8-4c6c-92eb-07c7366f16eb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:35.164057 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fa7329fa-56f8-4c6c-92eb-07c7366f16eb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:35.172457 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fa7329fa-56f8-4c6c-92eb-07c7366f16eb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 200 len: 1363 microversion: 2.1 time: 0.159873 Jun 16 15:06:35.173137 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 531/1056] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:35 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:36.117883 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-84395201-50d5-4f90-b7d6-546fd516097d req-7ea1793d-123d-4cd7-88a2-94b4eefdc412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc", "name": "network-vif-plugged", "status": "completed", "tag": "91200d16-5dc6-4b76-856c-ee259b54b7b7"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:06:36.128596 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-84395201-50d5-4f90-b7d6-546fd516097d req-7ea1793d-123d-4cd7-88a2-94b4eefdc412 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:36.129095 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-84395201-50d5-4f90-b7d6-546fd516097d req-7ea1793d-123d-4cd7-88a2-94b4eefdc412 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:36.141284 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-84395201-50d5-4f90-b7d6-546fd516097d req-7ea1793d-123d-4cd7-88a2-94b4eefdc412 service nova] Creating event network-vif-plugged:91200d16-5dc6-4b76-856c-ee259b54b7b7 for instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc on hv-cinder-83716 Jun 16 15:06:36.146591 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-84395201-50d5-4f90-b7d6-546fd516097d req-7ea1793d-123d-4cd7-88a2-94b4eefdc412 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032598 Jun 16 15:06:36.147409 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 526/1057] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:06:36.190611 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-befdec03-fdb7-44c4-99a8-08d1eb63bd0e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:36.191226 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-befdec03-fdb7-44c4-99a8-08d1eb63bd0e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:36.198857 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-befdec03-fdb7-44c4-99a8-08d1eb63bd0e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:36.199574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-befdec03-fdb7-44c4-99a8-08d1eb63bd0e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:36.200343 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-befdec03-fdb7-44c4-99a8-08d1eb63bd0e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:36.200972 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-befdec03-fdb7-44c4-99a8-08d1eb63bd0e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:36.375514 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-befdec03-fdb7-44c4-99a8-08d1eb63bd0e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:36.383135 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-befdec03-fdb7-44c4-99a8-08d1eb63bd0e tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 200 len: 1363 microversion: 2.1 time: 0.196777 Jun 16 15:06:36.383711 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 532/1058] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:36 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:37.401978 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f739021d-48dc-4031-a37a-da0ab6b949fd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:37.402595 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f739021d-48dc-4031-a37a-da0ab6b949fd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:37.409041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f739021d-48dc-4031-a37a-da0ab6b949fd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:37.409488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f739021d-48dc-4031-a37a-da0ab6b949fd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:37.410270 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f739021d-48dc-4031-a37a-da0ab6b949fd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:37.410699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f739021d-48dc-4031-a37a-da0ab6b949fd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:37.542461 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f739021d-48dc-4031-a37a-da0ab6b949fd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:37.549915 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f739021d-48dc-4031-a37a-da0ab6b949fd tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 200 len: 1363 microversion: 2.1 time: 0.153164 Jun 16 15:06:37.550478 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 527/1059] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:37 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:38.566610 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-076680d6-f846-4311-9827-273b6e562bb7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:38.567292 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-076680d6-f846-4311-9827-273b6e562bb7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:38.574098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-076680d6-f846-4311-9827-273b6e562bb7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:38.574618 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-076680d6-f846-4311-9827-273b6e562bb7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:38.575451 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-076680d6-f846-4311-9827-273b6e562bb7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:38.575945 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-076680d6-f846-4311-9827-273b6e562bb7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:38.710854 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-076680d6-f846-4311-9827-273b6e562bb7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:38.719726 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-076680d6-f846-4311-9827-273b6e562bb7 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 200 len: 1548 microversion: 2.1 time: 0.156910 Jun 16 15:06:38.720381 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 533/1060] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:06:38 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:06:38.736392 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c74e3abe-5154-4489-b2e4-d1ebed444123 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:38.736919 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c74e3abe-5154-4489-b2e4-d1ebed444123 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:38.743761 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c74e3abe-5154-4489-b2e4-d1ebed444123 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:38.744222 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c74e3abe-5154-4489-b2e4-d1ebed444123 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:38.745022 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c74e3abe-5154-4489-b2e4-d1ebed444123 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:38.745471 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c74e3abe-5154-4489-b2e4-d1ebed444123 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:38.827918 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c74e3abe-5154-4489-b2e4-d1ebed444123 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095531 Jun 16 15:06:38.828704 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 528/1061] 10.222.0.72 () {58 vars in 1274 bytes} [Thu Jun 16 15:06:38 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:06:40.016500 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-2661071e-c3d8-4d73-bf54-68080d786f15 req-906ae715-7293-4ad3-86cb-55e06dab8070 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc", "tag": "91200d16-5dc6-4b76-856c-ee259b54b7b7"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:06:40.025815 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-2661071e-c3d8-4d73-bf54-68080d786f15 req-906ae715-7293-4ad3-86cb-55e06dab8070 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:40.026291 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-2661071e-c3d8-4d73-bf54-68080d786f15 req-906ae715-7293-4ad3-86cb-55e06dab8070 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:40.037552 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-2661071e-c3d8-4d73-bf54-68080d786f15 req-906ae715-7293-4ad3-86cb-55e06dab8070 service nova] Creating event network-changed:91200d16-5dc6-4b76-856c-ee259b54b7b7 for instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc on hv-cinder-83716 Jun 16 15:06:40.042863 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-2661071e-c3d8-4d73-bf54-68080d786f15 req-906ae715-7293-4ad3-86cb-55e06dab8070 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030221 Jun 16 15:06:40.043466 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 534/1062] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:06:49.182846 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:49.183496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:49.188123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-08ec8ef5-07f7-476a-b821-bf7ab9b4740c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:49.188605 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-08ec8ef5-07f7-476a-b821-bf7ab9b4740c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:49.196607 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-08ec8ef5-07f7-476a-b821-bf7ab9b4740c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:49.197084 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-08ec8ef5-07f7-476a-b821-bf7ab9b4740c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:49.197845 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-08ec8ef5-07f7-476a-b821-bf7ab9b4740c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:49.198310 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-08ec8ef5-07f7-476a-b821-bf7ab9b4740c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:49.223238 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-08ec8ef5-07f7-476a-b821-bf7ab9b4740c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/ips" status: 200 len: 150 microversion: 2.1 time: 0.042407 Jun 16 15:06:49.223787 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 529/1063] 10.222.0.72 () {58 vars in 1247 bytes} [Thu Jun 16 15:06:49 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:06:50.539078 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ae2ec9d2-d312-4ab8-bea4-2f757f6c2e7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a0b391e-d685-490f-b42f-60f3d840ede3"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:06:50.540208 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ae2ec9d2-d312-4ab8-bea4-2f757f6c2e7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:50.543438 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:50.544180 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=70 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:06:50.550520 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ae2ec9d2-d312-4ab8-bea4-2f757f6c2e7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:50.551313 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ae2ec9d2-d312-4ab8-bea4-2f757f6c2e7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:50.552094 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ae2ec9d2-d312-4ab8-bea4-2f757f6c2e7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:50.552528 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ae2ec9d2-d312-4ab8-bea4-2f757f6c2e7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:50.989944 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ae2ec9d2-d312-4ab8-bea4-2f757f6c2e7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "POST /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.454851 Jun 16 15:06:50.990484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 535/1064] 10.222.0.72 () {60 vars in 1322 bytes} [Thu Jun 16 15:06:50 2022] POST /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments => generated 194 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:06:54.318084 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c1afdef7-0c81-493a-a79f-bf8b411a2bf9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:54.319510 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c1afdef7-0c81-493a-a79f-bf8b411a2bf9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:54.326184 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c1afdef7-0c81-493a-a79f-bf8b411a2bf9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:54.326644 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c1afdef7-0c81-493a-a79f-bf8b411a2bf9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:54.327419 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c1afdef7-0c81-493a-a79f-bf8b411a2bf9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:54.328060 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c1afdef7-0c81-493a-a79f-bf8b411a2bf9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:54.352017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c1afdef7-0c81-493a-a79f-bf8b411a2bf9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3/ips" status: 200 len: 151 microversion: 2.20 time: 0.038323 Jun 16 15:06:54.352511 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 530/1065] 10.222.0.72 () {60 vars in 1288 bytes} [Thu Jun 16 15:06:54 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 15:06:58.544593 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-447e4cbc-543c-4a36-9f46-390ea90bb06c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:06:58.545401 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-447e4cbc-543c-4a36-9f46-390ea90bb06c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:58.560012 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-447e4cbc-543c-4a36-9f46-390ea90bb06c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:58.560661 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-447e4cbc-543c-4a36-9f46-390ea90bb06c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:58.563211 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-447e4cbc-543c-4a36-9f46-390ea90bb06c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:58.564005 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-447e4cbc-543c-4a36-9f46-390ea90bb06c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:58.592521 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-114f3635-d6e3-4049-85f3-76dc5f52f15a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a0b391e-d685-490f-b42f-60f3d840ede3"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:06:58.594549 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-114f3635-d6e3-4049-85f3-76dc5f52f15a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:58.605805 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-114f3635-d6e3-4049-85f3-76dc5f52f15a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:58.606396 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-114f3635-d6e3-4049-85f3-76dc5f52f15a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:58.607418 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-114f3635-d6e3-4049-85f3-76dc5f52f15a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:58.607936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-114f3635-d6e3-4049-85f3-76dc5f52f15a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:58.609837 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-447e4cbc-543c-4a36-9f46-390ea90bb06c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lazy-loading 'flavor' on Instance uuid b53e3fc3-e13f-4352-ad2f-7babd83b19e3 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:06:58.722387 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-114f3635-d6e3-4049-85f3-76dc5f52f15a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] HTTP exception thrown: Invalid volume: volume 8a0b391e-d685-490f-b42f-60f3d840ede3 is already attached to instances: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-114f3635-d6e3-4049-85f3-76dc5f52f15a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Request method failure captured: Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: POST /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments HTTP/1.1 Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 74 Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TU2Gjo7bUkrQIinrAEmUizdcavVo4cOx7_e9CBdhqQMOL_HN88fbcSkNjz0fxmjx2YzvDmjFBGY4yiPbtaUHC4qF4lZPrXQHcA8kaogkzbM_Pr4t5ixnvBhbj3OMnQtdL4-hEGTH3GzOC14o5hpUT2K4iK3ilxCwb3lslIqMZDzIU Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:06:58.724131 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:06:58.725606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2940b81a86c2401db1aa432d9a0735eb", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:06:58.725606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:06:58.725606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:06:58.725606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:06:58.725606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:06:58.725606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:06:58.725606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:06:58.725606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 0b8be0ab53ae48af844bc281dee5f77c Jun 16 15:06:58.725606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:06:58.725606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Jun 16 15:06:58.725606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {"volumeAttachment": {"volumeId": "8a0b391e-d685-490f-b42f-60f3d840ede3"}} Jun 16 15:06:58.725606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:06:58.726378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Invalid volume: volume 8a0b391e-d685-490f-b42f-60f3d840ede3 is already attached to instances: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 Jun 16 15:06:58.726378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'server_id': '8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8', 'body': {'volumeAttachment': {'volumeId': '8a0b391e-d685-490f-b42f-60f3d840ede3'}}} Jun 16 15:06:58.726378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:06:58.726378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:06:58.726378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 15:06:58.726378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 15:06:58.726378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 15:06:58.726378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 15:06:58.726378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 15:06:58.726378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 15:06:58.726378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 15:06:58.726378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 15:06:58.726378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 15:06:58.726378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 15:06:58.726378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8a0b391e-d685-490f-b42f-60f3d840ede3 is already attached to instances: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 Jun 16 15:06:58.726378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:06:58.726378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:06:58.726378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:06:58.726378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8a0b391e-d685-490f-b42f-60f3d840ede3 is already attached to instances: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:06:58.727603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:06:58.729014 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:06:58.729014 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:06:58.729014 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:06:58.729014 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8a0b391e-d685-490f-b42f-60f3d840ede3 is already attached to instances: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 Jun 16 15:06:58.729014 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:06:58.729014 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-114f3635-d6e3-4049-85f3-76dc5f52f15a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Returning 400 to user: Invalid volume: volume 8a0b391e-d685-490f-b42f-60f3d840ede3 is already attached to instances: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:06:58.729014 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-114f3635-d6e3-4049-85f3-76dc5f52f15a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "POST /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.138739 Jun 16 15:06:58.729014 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 531/1066] 10.222.0.72 () {60 vars in 1322 bytes} [Thu Jun 16 15:06:58 2022] POST /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments => generated 174 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 15:06:58.801139 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2e8f5864-6e30-4c4a-a58d-b1b20e8ce7ff tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:58.801990 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2e8f5864-6e30-4c4a-a58d-b1b20e8ce7ff tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:58.811788 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e8f5864-6e30-4c4a-a58d-b1b20e8ce7ff tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:58.812347 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e8f5864-6e30-4c4a-a58d-b1b20e8ce7ff tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:58.813243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e8f5864-6e30-4c4a-a58d-b1b20e8ce7ff tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:58.815985 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e8f5864-6e30-4c4a-a58d-b1b20e8ce7ff tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:58.923372 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-2e8f5864-6e30-4c4a-a58d-b1b20e8ce7ff tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lazy-loading 'services' on Instance uuid 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:06:58.983986 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-447e4cbc-543c-4a36-9f46-390ea90bb06c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "POST /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3/action" status: 202 len: 0 microversion: 2.20 time: 0.444953 Jun 16 15:06:58.984993 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 536/1067] 10.222.0.72 () {62 vars in 1318 bytes} [Thu Jun 16 15:06:58 2022] POST /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:06:59.013649 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c24b9cb4-fd6d-4303-95bb-b6c751b6413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:59.014889 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c24b9cb4-fd6d-4303-95bb-b6c751b6413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:59.025215 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c24b9cb4-fd6d-4303-95bb-b6c751b6413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:59.026058 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c24b9cb4-fd6d-4303-95bb-b6c751b6413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:59.027257 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c24b9cb4-fd6d-4303-95bb-b6c751b6413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:59.028035 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c24b9cb4-fd6d-4303-95bb-b6c751b6413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:59.082070 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2e8f5864-6e30-4c4a-a58d-b1b20e8ce7ff tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "DELETE /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments/8a0b391e-d685-490f-b42f-60f3d840ede3" status: 202 len: 0 microversion: 2.1 time: 0.284287 Jun 16 15:06:59.082663 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 532/1068] 10.222.0.72 () {58 vars in 1415 bytes} [Thu Jun 16 15:06:58 2022] DELETE /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments/8a0b391e-d685-490f-b42f-60f3d840ede3 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 15:06:59.092270 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e417ac1b-f8d3-439e-a5a1-1d4fd91789fc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:06:59.093308 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e417ac1b-f8d3-439e-a5a1-1d4fd91789fc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:06:59.099593 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e417ac1b-f8d3-439e-a5a1-1d4fd91789fc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:59.100043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e417ac1b-f8d3-439e-a5a1-1d4fd91789fc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:59.100808 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e417ac1b-f8d3-439e-a5a1-1d4fd91789fc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:06:59.101267 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e417ac1b-f8d3-439e-a5a1-1d4fd91789fc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:06:59.143548 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e417ac1b-f8d3-439e-a5a1-1d4fd91789fc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055642 Jun 16 15:06:59.148062 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 533/1069] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:06:59 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:06:59.200218 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c24b9cb4-fd6d-4303-95bb-b6c751b6413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:59.223602 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c24b9cb4-fd6d-4303-95bb-b6c751b6413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:59.226088 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c24b9cb4-fd6d-4303-95bb-b6c751b6413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:06:59.228471 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c24b9cb4-fd6d-4303-95bb-b6c751b6413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.237746 Jun 16 15:06:59.229481 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 537/1070] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:06:58 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:00.156356 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ca50b22b-7500-4efe-a9ad-a9a37b6987b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:00.157736 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ca50b22b-7500-4efe-a9ad-a9a37b6987b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:00.167134 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ca50b22b-7500-4efe-a9ad-a9a37b6987b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:00.167731 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ca50b22b-7500-4efe-a9ad-a9a37b6987b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:00.168512 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ca50b22b-7500-4efe-a9ad-a9a37b6987b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:00.169123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ca50b22b-7500-4efe-a9ad-a9a37b6987b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:00.201724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ca50b22b-7500-4efe-a9ad-a9a37b6987b1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050391 Jun 16 15:07:00.202474 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 534/1071] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:07:00 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:00.248242 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-56efa86b-0c92-43ae-b21a-27b3b4846e5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:00.249071 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-56efa86b-0c92-43ae-b21a-27b3b4846e5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:00.255965 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-56efa86b-0c92-43ae-b21a-27b3b4846e5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:00.256411 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-56efa86b-0c92-43ae-b21a-27b3b4846e5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:00.257193 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-56efa86b-0c92-43ae-b21a-27b3b4846e5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:00.257815 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-56efa86b-0c92-43ae-b21a-27b3b4846e5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:00.452988 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-56efa86b-0c92-43ae-b21a-27b3b4846e5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:00.465951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-56efa86b-0c92-43ae-b21a-27b3b4846e5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:00.468830 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-56efa86b-0c92-43ae-b21a-27b3b4846e5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:00.470097 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-56efa86b-0c92-43ae-b21a-27b3b4846e5d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.226454 Jun 16 15:07:00.473955 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 538/1072] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:00 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:07:01.214394 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-457fd207-2a57-40a8-8b81-5452925b2d32 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:01.215989 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-457fd207-2a57-40a8-8b81-5452925b2d32 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:01.223930 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-457fd207-2a57-40a8-8b81-5452925b2d32 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:01.224635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-457fd207-2a57-40a8-8b81-5452925b2d32 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:01.225640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-457fd207-2a57-40a8-8b81-5452925b2d32 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:01.226232 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-457fd207-2a57-40a8-8b81-5452925b2d32 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:01.262181 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-457fd207-2a57-40a8-8b81-5452925b2d32 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053023 Jun 16 15:07:01.263027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 535/1073] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:07:01 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:01.492441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-28c00e8f-d970-4a20-a122-519fb7ea7e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:01.493190 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-28c00e8f-d970-4a20-a122-519fb7ea7e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:01.503505 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-28c00e8f-d970-4a20-a122-519fb7ea7e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:01.507963 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-28c00e8f-d970-4a20-a122-519fb7ea7e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:01.511700 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-28c00e8f-d970-4a20-a122-519fb7ea7e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:01.512072 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-28c00e8f-d970-4a20-a122-519fb7ea7e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:01.852058 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-28c00e8f-d970-4a20-a122-519fb7ea7e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:01.870216 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-28c00e8f-d970-4a20-a122-519fb7ea7e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:01.874298 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-28c00e8f-d970-4a20-a122-519fb7ea7e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:01.886439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-28c00e8f-d970-4a20-a122-519fb7ea7e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.390057 Jun 16 15:07:01.888085 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 539/1074] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:01 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:02.275252 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9e0f73ae-6003-4469-8719-d9313797f130 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:02.277000 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9e0f73ae-6003-4469-8719-d9313797f130 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:02.284590 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9e0f73ae-6003-4469-8719-d9313797f130 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:02.285205 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9e0f73ae-6003-4469-8719-d9313797f130 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:02.286008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9e0f73ae-6003-4469-8719-d9313797f130 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:02.287130 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9e0f73ae-6003-4469-8719-d9313797f130 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:02.327707 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9e0f73ae-6003-4469-8719-d9313797f130 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057346 Jun 16 15:07:02.332121 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 536/1075] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:07:02 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:02.909511 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a7a5d40c-1214-4ab7-8b75-e5e443a72fcd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:02.910136 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a7a5d40c-1214-4ab7-8b75-e5e443a72fcd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:02.927076 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7a5d40c-1214-4ab7-8b75-e5e443a72fcd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:02.927815 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7a5d40c-1214-4ab7-8b75-e5e443a72fcd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:02.928853 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7a5d40c-1214-4ab7-8b75-e5e443a72fcd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:02.929574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7a5d40c-1214-4ab7-8b75-e5e443a72fcd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:03.122357 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a7a5d40c-1214-4ab7-8b75-e5e443a72fcd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:03.136574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a7a5d40c-1214-4ab7-8b75-e5e443a72fcd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:03.138267 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a7a5d40c-1214-4ab7-8b75-e5e443a72fcd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:03.139446 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a7a5d40c-1214-4ab7-8b75-e5e443a72fcd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.237689 Jun 16 15:07:03.140010 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 540/1076] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:02 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:03.340428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b1dfc8a1-dbb4-4458-a1b3-73423d032454 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:03.342199 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b1dfc8a1-dbb4-4458-a1b3-73423d032454 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:03.350341 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b1dfc8a1-dbb4-4458-a1b3-73423d032454 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:03.351127 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b1dfc8a1-dbb4-4458-a1b3-73423d032454 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:03.352662 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b1dfc8a1-dbb4-4458-a1b3-73423d032454 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:03.353362 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b1dfc8a1-dbb4-4458-a1b3-73423d032454 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:03.397821 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b1dfc8a1-dbb4-4458-a1b3-73423d032454 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061274 Jun 16 15:07:03.398875 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 537/1077] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:07:03 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:03.790121 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8af90e0c-0661-4a35-bc62-a4cbc1141174 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Action: 'create', calling method: .version_select at 0x7faabaa19550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1156471918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmz3BA+Edz4U01sp/KuhwzIV5sDpgLghB1ou2x7hhHxC8Lif0wFxUvVVSpnr5NzYvmKvIPQupR5p0esK1VowbPzJTQ+mq6POgQoxcfnMHvUM6FnOeoWKBiUC79PuOflrw=="}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:03.804606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-8af90e0c-0661-4a35-bc62-a4cbc1141174 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Getting quotas for project 3716e192b1194365acb5595c8f92a862. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:07:03.808370 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-8af90e0c-0661-4a35-bc62-a4cbc1141174 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Getting quotas for user 0e6fbab71db54b698572bb8a7d033063 and project 3716e192b1194365acb5595c8f92a862. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:07:03.832020 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8af90e0c-0661-4a35-bc62-a4cbc1141174 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.207493 Jun 16 15:07:03.832592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 541/1078] 10.222.0.72 () {60 vars in 1158 bytes} [Thu Jun 16 15:07:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:04.158614 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-562dc428-902e-4962-9987-cec17955f4e4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:04.159441 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-562dc428-902e-4962-9987-cec17955f4e4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:04.165840 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-562dc428-902e-4962-9987-cec17955f4e4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:04.166286 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-562dc428-902e-4962-9987-cec17955f4e4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:04.167171 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-562dc428-902e-4962-9987-cec17955f4e4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:04.167608 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-562dc428-902e-4962-9987-cec17955f4e4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:04.362701 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-562dc428-902e-4962-9987-cec17955f4e4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:04.383578 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-562dc428-902e-4962-9987-cec17955f4e4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:04.385696 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-562dc428-902e-4962-9987-cec17955f4e4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:04.386900 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-562dc428-902e-4962-9987-cec17955f4e4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.232857 Jun 16 15:07:04.387781 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 538/1079] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:04 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:04.411416 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3f746c70-085d-41ff-af77-f8db176461a1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:04.412237 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3f746c70-085d-41ff-af77-f8db176461a1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:04.420442 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3f746c70-085d-41ff-af77-f8db176461a1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:04.420927 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3f746c70-085d-41ff-af77-f8db176461a1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:04.421729 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3f746c70-085d-41ff-af77-f8db176461a1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:04.422159 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3f746c70-085d-41ff-af77-f8db176461a1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:04.453907 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3f746c70-085d-41ff-af77-f8db176461a1 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047462 Jun 16 15:07:04.454489 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 542/1080] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:07:04 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:05.228583 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3b5157ea-af7f-434e-86c3-29f7bf684aad tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1500212629", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1659470293", "security_groups": [{"name": "tempest-secgroup-smoke-425536924"}], "block_device_mapping_v2": [{"uuid": "4c32aaa7-491d-4794-b934-1a154b14f5ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "90f95ec0-4a81-440f-8fe5-a85002b7b63b"}]}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:05.407522 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-577aa3c5-90ba-45f2-9c54-0cf31c4c76f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:05.408769 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-577aa3c5-90ba-45f2-9c54-0cf31c4c76f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:05.416945 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-3b5157ea-af7f-434e-86c3-29f7bf684aad tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] validate_networks() for [('90f95ec0-4a81-440f-8fe5-a85002b7b63b', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:07:05.418900 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-577aa3c5-90ba-45f2-9c54-0cf31c4c76f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:05.420198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-577aa3c5-90ba-45f2-9c54-0cf31c4c76f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:05.421257 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-577aa3c5-90ba-45f2-9c54-0cf31c4c76f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:05.421886 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-577aa3c5-90ba-45f2-9c54-0cf31c4c76f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:05.636793 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-577aa3c5-90ba-45f2-9c54-0cf31c4c76f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:05.653629 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-577aa3c5-90ba-45f2-9c54-0cf31c4c76f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:05.655403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-577aa3c5-90ba-45f2-9c54-0cf31c4c76f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:05.657445 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-577aa3c5-90ba-45f2-9c54-0cf31c4c76f4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.254414 Jun 16 15:07:05.658748 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 543/1081] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:05 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:05.665144 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8eaac6f3-0f3b-4b25-a71e-711320b88780 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:05.666484 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8eaac6f3-0f3b-4b25-a71e-711320b88780 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:05.674964 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8eaac6f3-0f3b-4b25-a71e-711320b88780 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:05.675411 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8eaac6f3-0f3b-4b25-a71e-711320b88780 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:05.676184 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8eaac6f3-0f3b-4b25-a71e-711320b88780 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:05.676618 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8eaac6f3-0f3b-4b25-a71e-711320b88780 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:05.717115 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8eaac6f3-0f3b-4b25-a71e-711320b88780 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056197 Jun 16 15:07:05.717741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 544/1082] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:07:05 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 15:07:05.781086 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-68930c2f-0d21-4528-8025-2afcad93301a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:05.781581 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-68930c2f-0d21-4528-8025-2afcad93301a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:05.792106 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-68930c2f-0d21-4528-8025-2afcad93301a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:05.792556 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-68930c2f-0d21-4528-8025-2afcad93301a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:05.795446 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-68930c2f-0d21-4528-8025-2afcad93301a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:05.795934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-68930c2f-0d21-4528-8025-2afcad93301a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:05.826144 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-68930c2f-0d21-4528-8025-2afcad93301a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:07:05.926023 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-68930c2f-0d21-4528-8025-2afcad93301a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "DELETE /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 204 len: 0 microversion: 2.1 time: 0.148488 Jun 16 15:07:05.926751 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 545/1083] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:07:05 2022] DELETE /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:07:05.930908 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-3b5157ea-af7f-434e-86c3-29f7bf684aad tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:07:05.931573 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-3b5157ea-af7f-434e-86c3-29f7bf684aad tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:07:05.932880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-3b5157ea-af7f-434e-86c3-29f7bf684aad tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:07:05.933566 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-3b5157ea-af7f-434e-86c3-29f7bf684aad tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:07:05.934139 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-3b5157ea-af7f-434e-86c3-29f7bf684aad tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:07:05.937789 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-76b614d3-2dae-43e5-a7e9-c0e48230eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:05.938477 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-76b614d3-2dae-43e5-a7e9-c0e48230eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:05.945891 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-76b614d3-2dae-43e5-a7e9-c0e48230eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:05.946869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-76b614d3-2dae-43e5-a7e9-c0e48230eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:05.947666 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3b5157ea-af7f-434e-86c3-29f7bf684aad tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:05.947804 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-76b614d3-2dae-43e5-a7e9-c0e48230eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:05.948136 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3b5157ea-af7f-434e-86c3-29f7bf684aad tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:05.948284 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-76b614d3-2dae-43e5-a7e9-c0e48230eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:05.948963 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3b5157ea-af7f-434e-86c3-29f7bf684aad tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:05.949732 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3b5157ea-af7f-434e-86c3-29f7bf684aad tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:05.970099 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-3b5157ea-af7f-434e-86c3-29f7bf684aad tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Getting quotas for project 05223500b4a142c7a77c2de010541b84. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:07:05.974696 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-3b5157ea-af7f-434e-86c3-29f7bf684aad tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Getting quotas for user 9d977f609537476daa8fe8adbab9ff9c and project 05223500b4a142c7a77c2de010541b84. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:07:06.044909 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3b5157ea-af7f-434e-86c3-29f7bf684aad tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:07:06.047309 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3b5157ea-af7f-434e-86c3-29f7bf684aad tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4c32aaa7-491d-4794-b934-1a154b14f5ef',volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:07:06.105445 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-76b614d3-2dae-43e5-a7e9-c0e48230eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:06.114342 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-76b614d3-2dae-43e5-a7e9-c0e48230eb7f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1681 microversion: 2.1 time: 0.180996 Jun 16 15:07:06.114925 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 546/1084] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:05 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:06.186713 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3b5157ea-af7f-434e-86c3-29f7bf684aad tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.961978 Jun 16 15:07:06.187356 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 539/1085] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 15:07:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 15:07:06.199454 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-355b1bd5-f7e0-44ed-8c2d-579a2ac9880c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:06.200318 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-355b1bd5-f7e0-44ed-8c2d-579a2ac9880c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:06.258565 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-355b1bd5-f7e0-44ed-8c2d-579a2ac9880c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:06.266492 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-355b1bd5-f7e0-44ed-8c2d-579a2ac9880c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1095 microversion: 2.1 time: 0.072392 Jun 16 15:07:06.267285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 547/1086] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:06 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:06.676790 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c49f82e2-5fc2-4bdc-a8ed-af8009a8982c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:06.677453 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c49f82e2-5fc2-4bdc-a8ed-af8009a8982c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:06.685210 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c49f82e2-5fc2-4bdc-a8ed-af8009a8982c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:06.685945 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c49f82e2-5fc2-4bdc-a8ed-af8009a8982c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:06.686736 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c49f82e2-5fc2-4bdc-a8ed-af8009a8982c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:06.687181 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c49f82e2-5fc2-4bdc-a8ed-af8009a8982c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:06.818712 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c49f82e2-5fc2-4bdc-a8ed-af8009a8982c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:06.831657 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c49f82e2-5fc2-4bdc-a8ed-af8009a8982c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:06.833203 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c49f82e2-5fc2-4bdc-a8ed-af8009a8982c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:06.834382 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c49f82e2-5fc2-4bdc-a8ed-af8009a8982c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.162754 Jun 16 15:07:06.834935 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 540/1087] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:06 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:07:07.131451 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a0d12026-42e4-4a50-b830-46a392dde95b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:07.132061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a0d12026-42e4-4a50-b830-46a392dde95b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:07.139797 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a0d12026-42e4-4a50-b830-46a392dde95b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:07.140252 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a0d12026-42e4-4a50-b830-46a392dde95b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:07.141053 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a0d12026-42e4-4a50-b830-46a392dde95b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:07.141491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a0d12026-42e4-4a50-b830-46a392dde95b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:07.159916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:07.279894 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a0d12026-42e4-4a50-b830-46a392dde95b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:07.290670 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a0d12026-42e4-4a50-b830-46a392dde95b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1681 microversion: 2.1 time: 0.162879 Jun 16 15:07:07.299005 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9217c1d8-5d36-424e-9355-9635acc3a1ea tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:07.299632 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9217c1d8-5d36-424e-9355-9635acc3a1ea tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:07.302162 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 548/1088] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:07 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:07.325260 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9217c1d8-5d36-424e-9355-9635acc3a1ea tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:07.325851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9217c1d8-5d36-424e-9355-9635acc3a1ea tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:07.326690 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9217c1d8-5d36-424e-9355-9635acc3a1ea tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:07.327340 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9217c1d8-5d36-424e-9355-9635acc3a1ea tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:07.403616 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9217c1d8-5d36-424e-9355-9635acc3a1ea tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:07.416022 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9217c1d8-5d36-424e-9355-9635acc3a1ea tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1145 microversion: 2.1 time: 0.131853 Jun 16 15:07:07.427009 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 541/1089] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:07 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1145 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:07.854116 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8db13df3-8d44-4f88-931b-7d4a16a08b59 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:07.854712 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8db13df3-8d44-4f88-931b-7d4a16a08b59 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:07.862052 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8db13df3-8d44-4f88-931b-7d4a16a08b59 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:07.862889 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8db13df3-8d44-4f88-931b-7d4a16a08b59 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:07.863679 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8db13df3-8d44-4f88-931b-7d4a16a08b59 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:07.864119 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8db13df3-8d44-4f88-931b-7d4a16a08b59 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:08.012059 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8db13df3-8d44-4f88-931b-7d4a16a08b59 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:08.024079 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8db13df3-8d44-4f88-931b-7d4a16a08b59 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:08.026433 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8db13df3-8d44-4f88-931b-7d4a16a08b59 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:08.027884 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8db13df3-8d44-4f88-931b-7d4a16a08b59 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.178497 Jun 16 15:07:08.029206 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 549/1090] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:07 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:08.307945 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8b5ab864-4623-4412-ba73-45e4fdb3a7bd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:08.308536 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8b5ab864-4623-4412-ba73-45e4fdb3a7bd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:08.315368 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8b5ab864-4623-4412-ba73-45e4fdb3a7bd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:08.315826 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8b5ab864-4623-4412-ba73-45e4fdb3a7bd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:08.316594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8b5ab864-4623-4412-ba73-45e4fdb3a7bd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:08.317066 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8b5ab864-4623-4412-ba73-45e4fdb3a7bd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:08.433456 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-18eea83c-d1f9-45c4-a025-65ef7da0fca6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:08.434129 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-18eea83c-d1f9-45c4-a025-65ef7da0fca6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:08.441696 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-18eea83c-d1f9-45c4-a025-65ef7da0fca6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:08.442416 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-18eea83c-d1f9-45c4-a025-65ef7da0fca6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:08.443626 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-18eea83c-d1f9-45c4-a025-65ef7da0fca6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:08.444261 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-18eea83c-d1f9-45c4-a025-65ef7da0fca6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:08.477067 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8b5ab864-4623-4412-ba73-45e4fdb3a7bd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:08.486517 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8b5ab864-4623-4412-ba73-45e4fdb3a7bd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1681 microversion: 2.1 time: 0.182319 Jun 16 15:07:08.487005 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 542/1091] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:08 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:08.523389 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-18eea83c-d1f9-45c4-a025-65ef7da0fca6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:08.535929 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-18eea83c-d1f9-45c4-a025-65ef7da0fca6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1201 microversion: 2.1 time: 0.105788 Jun 16 15:07:08.537557 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 550/1092] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:08 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1201 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:09.047432 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-570b068d-4ef4-45c9-b9a5-2e123d35c7d4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:09.048939 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-570b068d-4ef4-45c9-b9a5-2e123d35c7d4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:09.055587 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-570b068d-4ef4-45c9-b9a5-2e123d35c7d4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:09.056344 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-570b068d-4ef4-45c9-b9a5-2e123d35c7d4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:09.057234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-570b068d-4ef4-45c9-b9a5-2e123d35c7d4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:09.057801 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-570b068d-4ef4-45c9-b9a5-2e123d35c7d4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:09.504059 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-cc67bcda-42a4-40d0-911b-a3410891bbdf tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:09.504788 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-cc67bcda-42a4-40d0-911b-a3410891bbdf tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:09.512221 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cc67bcda-42a4-40d0-911b-a3410891bbdf tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:09.512796 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cc67bcda-42a4-40d0-911b-a3410891bbdf tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:09.513746 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cc67bcda-42a4-40d0-911b-a3410891bbdf tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:09.514334 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cc67bcda-42a4-40d0-911b-a3410891bbdf tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:09.723744 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-cc67bcda-42a4-40d0-911b-a3410891bbdf tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:09.733029 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-cc67bcda-42a4-40d0-911b-a3410891bbdf tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1681 microversion: 2.1 time: 0.233111 Jun 16 15:07:09.733595 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 551/1093] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:09 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:09.738056 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ee673956-f213-48cf-8646-4e1330f173ed tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:09.738871 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ee673956-f213-48cf-8646-4e1330f173ed tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:09.748922 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ee673956-f213-48cf-8646-4e1330f173ed tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:09.749379 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ee673956-f213-48cf-8646-4e1330f173ed tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:09.749903 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-570b068d-4ef4-45c9-b9a5-2e123d35c7d4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:09.750385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ee673956-f213-48cf-8646-4e1330f173ed tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:09.750598 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ee673956-f213-48cf-8646-4e1330f173ed tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:09.759779 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-570b068d-4ef4-45c9-b9a5-2e123d35c7d4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:09.761910 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-570b068d-4ef4-45c9-b9a5-2e123d35c7d4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:09.763186 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-570b068d-4ef4-45c9-b9a5-2e123d35c7d4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.720326 Jun 16 15:07:09.763801 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 543/1094] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:09 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:09.833891 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ee673956-f213-48cf-8646-4e1330f173ed tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:09.843636 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ee673956-f213-48cf-8646-4e1330f173ed tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1211 microversion: 2.1 time: 0.109051 Jun 16 15:07:09.844207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 552/1095] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:09 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1211 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:10.708126 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-1ca9a737-324a-4816-b73a-0fc593df19f2 req-5c777cf5-8ffc-4e04-b42c-5816d146a5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8", "name": "network-vif-deleted", "tag": "b8c5c8c1-cea0-4f6d-81a6-8b5e602aa5f3"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:10.741109 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-1ca9a737-324a-4816-b73a-0fc593df19f2 req-5c777cf5-8ffc-4e04-b42c-5816d146a5c9 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:10.752379 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1ee08a77-f6c3-4f94-a9c1-2a58191003de tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:10.753166 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1ee08a77-f6c3-4f94-a9c1-2a58191003de tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:10.757158 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-1ca9a737-324a-4816-b73a-0fc593df19f2 req-5c777cf5-8ffc-4e04-b42c-5816d146a5c9 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:10.768492 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1ee08a77-f6c3-4f94-a9c1-2a58191003de tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:10.769400 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1ee08a77-f6c3-4f94-a9c1-2a58191003de tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:10.770558 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1ee08a77-f6c3-4f94-a9c1-2a58191003de tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:10.771239 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1ee08a77-f6c3-4f94-a9c1-2a58191003de tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:10.784753 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-1ca9a737-324a-4816-b73a-0fc593df19f2 req-5c777cf5-8ffc-4e04-b42c-5816d146a5c9 service nova] Creating event network-vif-deleted:b8c5c8c1-cea0-4f6d-81a6-8b5e602aa5f3 for instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 on hv-cinder-83716 Jun 16 15:07:10.791817 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-1ca9a737-324a-4816-b73a-0fc593df19f2 req-5c777cf5-8ffc-4e04-b42c-5816d146a5c9 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088290 Jun 16 15:07:10.793206 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 544/1096] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:07:10.804212 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-de2124d3-95bd-476c-b67a-4abf78b09514 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:10.809928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-de2124d3-95bd-476c-b67a-4abf78b09514 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:10.824696 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-de2124d3-95bd-476c-b67a-4abf78b09514 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:10.825325 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-de2124d3-95bd-476c-b67a-4abf78b09514 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:10.826107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-de2124d3-95bd-476c-b67a-4abf78b09514 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:10.829000 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-de2124d3-95bd-476c-b67a-4abf78b09514 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:10.945760 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1ee08a77-f6c3-4f94-a9c1-2a58191003de tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:10.954332 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1ee08a77-f6c3-4f94-a9c1-2a58191003de tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 200 len: 1325 microversion: 2.1 time: 0.206625 Jun 16 15:07:10.964278 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 553/1097] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:10 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 1325 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:10.965185 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1ba71442-91f5-4aef-a7f6-67992da31dd7 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:10.965903 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1ba71442-91f5-4aef-a7f6-67992da31dd7 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:10.974342 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1ba71442-91f5-4aef-a7f6-67992da31dd7 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:10.974932 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1ba71442-91f5-4aef-a7f6-67992da31dd7 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:10.976652 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1ba71442-91f5-4aef-a7f6-67992da31dd7 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:10.978618 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1ba71442-91f5-4aef-a7f6-67992da31dd7 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:11.136891 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-de2124d3-95bd-476c-b67a-4abf78b09514 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:11.138959 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1ba71442-91f5-4aef-a7f6-67992da31dd7 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:11.146532 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-de2124d3-95bd-476c-b67a-4abf78b09514 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:11.148593 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-de2124d3-95bd-476c-b67a-4abf78b09514 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:11.150569 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-de2124d3-95bd-476c-b67a-4abf78b09514 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.355880 Jun 16 15:07:11.151594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 545/1098] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:10 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:11.162378 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1ba71442-91f5-4aef-a7f6-67992da31dd7 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1266 microversion: 2.1 time: 0.190754 Jun 16 15:07:11.163126 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 554/1099] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:10 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1266 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:11.971568 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8c263332-5d3e-4670-b311-5d84dca219ed tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:11.972203 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8c263332-5d3e-4670-b311-5d84dca219ed tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:11.979627 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c263332-5d3e-4670-b311-5d84dca219ed tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:11.980087 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c263332-5d3e-4670-b311-5d84dca219ed tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:11.980966 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c263332-5d3e-4670-b311-5d84dca219ed tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:11.981414 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c263332-5d3e-4670-b311-5d84dca219ed tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:12.001583 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-8c263332-5d3e-4670-b311-5d84dca219ed tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] HTTP exception thrown: Instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 could not be found. Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8c263332-5d3e-4670-b311-5d84dca219ed tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Request method failure captured: Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 HTTP/1.1 Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TU2Gjo7bUkrQIinrAEmUizdcavVo4cOx7_e9CBdhqQMOL_HN88fbcSkNjz0fxmjx2YzvDmjFBGY4yiPbtaUHC4qF4lZPrXQHcA8kaogkzbM_Pr4t5ixnvBhbj3OMnQtdL4-hEGTH3GzOC14o5hpUT2K4iK3ilxCwb3lslIqMZDzIU Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:07:12.003428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:07:12.005141 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2940b81a86c2401db1aa432d9a0735eb", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:07:12.005141 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:07:12.005141 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:07:12.005141 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:07:12.005141 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:07:12.005141 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:07:12.005141 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:07:12.005141 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 0b8be0ab53ae48af844bc281dee5f77c Jun 16 15:07:12.005141 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:07:12.005141 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:07:12.005141 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 could not be found. Jun 16 15:07:12.005141 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': '8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8'} Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 could not be found. Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:07:12.005979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:07:12.007497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:07:12.007497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:07:12.007497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:07:12.007497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:07:12.007497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:07:12.007497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:07:12.007497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:07:12.007497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 could not be found. Jun 16 15:07:12.007497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:07:12.007497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:07:12.007497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:07:12.007497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:07:12.007497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:07:12.007497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:07:12.007497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:07:12.007497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:07:12.007497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 could not be found. Jun 16 15:07:12.007497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:07:12.008726 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8c263332-5d3e-4670-b311-5d84dca219ed tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Returning 404 to user: Instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:07:12.008726 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8c263332-5d3e-4670-b311-5d84dca219ed tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 404 len: 111 microversion: 2.1 time: 0.038030 Jun 16 15:07:12.008726 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 546/1100] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:11 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:07:12.016274 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c8d76bd3-16c0-4ba3-a6a7-d14685d19946 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '.version_select at 0x7faabaa918b0>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:12.034912 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c8d76bd3-16c0-4ba3-a6a7-d14685d19946 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-340238400" status: 202 len: 0 microversion: 2.1 time: 0.022742 Jun 16 15:07:12.035491 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 555/1101] 10.222.0.72 () {58 vars in 1217 bytes} [Thu Jun 16 15:07:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-340238400 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:07:12.178171 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-89807f6b-9a17-473f-bc7c-eca1b45094e2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:12.178171 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-89807f6b-9a17-473f-bc7c-eca1b45094e2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:12.186183 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-07b8bef4-5885-48d4-9566-daaa0f98944e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:12.190141 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-07b8bef4-5885-48d4-9566-daaa0f98944e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:12.193565 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-89807f6b-9a17-473f-bc7c-eca1b45094e2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:12.194279 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-89807f6b-9a17-473f-bc7c-eca1b45094e2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:12.195303 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-89807f6b-9a17-473f-bc7c-eca1b45094e2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:12.195958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-89807f6b-9a17-473f-bc7c-eca1b45094e2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:12.210427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-07b8bef4-5885-48d4-9566-daaa0f98944e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:12.210427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-07b8bef4-5885-48d4-9566-daaa0f98944e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:12.216394 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:12.218234 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-07b8bef4-5885-48d4-9566-daaa0f98944e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:12.218694 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-07b8bef4-5885-48d4-9566-daaa0f98944e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:12.370008 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-07b8bef4-5885-48d4-9566-daaa0f98944e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:12.377684 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-07b8bef4-5885-48d4-9566-daaa0f98944e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1266 microversion: 2.1 time: 0.200957 Jun 16 15:07:12.378257 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 556/1102] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:12 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:12.473375 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-89807f6b-9a17-473f-bc7c-eca1b45094e2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:12.482130 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-89807f6b-9a17-473f-bc7c-eca1b45094e2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:12.483618 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-89807f6b-9a17-473f-bc7c-eca1b45094e2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:12.484780 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-89807f6b-9a17-473f-bc7c-eca1b45094e2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.318693 Jun 16 15:07:12.485356 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 547/1103] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:12 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:12.756118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-483543ab-519d-47f8-bd4d-de6456fa095c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Action: 'create', calling method: .version_select at 0x7faab5e0d160>, body: {"keypair": {"name": "tempest-keypair-417679563", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFkiIpoEt1QDOBcH1eY7mTx5rrib2B9wmDOSr7kCVL5GFqIweB+/muy4/XJhvTYYDgyDCteEkk43pzmN6kQg7l2ht+SzJWxZlGxduDNiqmp8H0QL2VN4neN/CNvC34ysg=="}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:12.771204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-483543ab-519d-47f8-bd4d-de6456fa095c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Getting quotas for project 2940b81a86c2401db1aa432d9a0735eb. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:07:12.775592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-483543ab-519d-47f8-bd4d-de6456fa095c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Getting quotas for user 0b8be0ab53ae48af844bc281dee5f77c and project 2940b81a86c2401db1aa432d9a0735eb. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:07:12.798210 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-483543ab-519d-47f8-bd4d-de6456fa095c tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045965 Jun 16 15:07:12.798841 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 557/1104] 10.222.0.72 () {60 vars in 1158 bytes} [Thu Jun 16 15:07:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:12.839053 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-7fc4eb8a-5f58-4697-82ec-8e6b8362a6d1 req-138e5d88-8ec9-41c8-b720-6897a34fccde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "396d3e73-5c6a-4889-84e6-7a440d744018", "tag": "4dcaa0bd-2a2c-4ab0-8ae1-a7aca82c5393"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:12.847632 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-7fc4eb8a-5f58-4697-82ec-8e6b8362a6d1 req-138e5d88-8ec9-41c8-b720-6897a34fccde service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:12.848092 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-7fc4eb8a-5f58-4697-82ec-8e6b8362a6d1 req-138e5d88-8ec9-41c8-b720-6897a34fccde service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:12.859799 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-7fc4eb8a-5f58-4697-82ec-8e6b8362a6d1 req-138e5d88-8ec9-41c8-b720-6897a34fccde service nova] Creating event network-changed:4dcaa0bd-2a2c-4ab0-8ae1-a7aca82c5393 for instance 396d3e73-5c6a-4889-84e6-7a440d744018 on hv-cinder-83716 Jun 16 15:07:12.872290 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-7fc4eb8a-5f58-4697-82ec-8e6b8362a6d1 req-138e5d88-8ec9-41c8-b720-6897a34fccde service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038039 Jun 16 15:07:12.872290 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 548/1105] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:13.396542 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c6a1f5ce-0bf6-4a90-bc54-0fc67eade1ec tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:13.397219 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c6a1f5ce-0bf6-4a90-bc54-0fc67eade1ec tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:13.405146 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c6a1f5ce-0bf6-4a90-bc54-0fc67eade1ec tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:13.405595 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c6a1f5ce-0bf6-4a90-bc54-0fc67eade1ec tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:13.406356 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c6a1f5ce-0bf6-4a90-bc54-0fc67eade1ec tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:13.407269 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c6a1f5ce-0bf6-4a90-bc54-0fc67eade1ec tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:13.504253 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d65b908e-4f1e-45ad-8ad8-1b27b7d7c371 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:13.505759 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d65b908e-4f1e-45ad-8ad8-1b27b7d7c371 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:13.513210 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d65b908e-4f1e-45ad-8ad8-1b27b7d7c371 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:13.513667 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d65b908e-4f1e-45ad-8ad8-1b27b7d7c371 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:13.514450 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d65b908e-4f1e-45ad-8ad8-1b27b7d7c371 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:13.514894 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d65b908e-4f1e-45ad-8ad8-1b27b7d7c371 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:13.628966 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c6a1f5ce-0bf6-4a90-bc54-0fc67eade1ec tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:13.645129 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c6a1f5ce-0bf6-4a90-bc54-0fc67eade1ec tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1266 microversion: 2.1 time: 0.253510 Jun 16 15:07:13.653956 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 558/1106] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:13 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:13.756993 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d65b908e-4f1e-45ad-8ad8-1b27b7d7c371 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:13.767328 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d65b908e-4f1e-45ad-8ad8-1b27b7d7c371 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:13.769229 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d65b908e-4f1e-45ad-8ad8-1b27b7d7c371 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:13.770469 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d65b908e-4f1e-45ad-8ad8-1b27b7d7c371 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.270509 Jun 16 15:07:13.771032 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 549/1107] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:13 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:07:14.250201 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-19ee290f-9a6b-4f12-a4a1-62dadf17b110 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1011200788", "imageRef": "23371504-a4d6-4064-90b4-87bfd0a15170", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "585283c3-d940-441f-ba61-bbe0dfecbee8"}], "security_groups": [{"name": "tempest-securitygroup--887928311"}], "key_name": "tempest-keypair-417679563", "user_data": "}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:14.351363 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.network.neutron [None req-19ee290f-9a6b-4f12-a4a1-62dadf17b110 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] validate_networks() for [('585283c3-d940-441f-ba61-bbe0dfecbee8', None, None, None, None, None)] {{(pid=124589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:07:14.662710 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-efc1497e-a479-4ecb-8ba5-8a88d77846a5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:14.663333 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-efc1497e-a479-4ecb-8ba5-8a88d77846a5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:14.670211 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-efc1497e-a479-4ecb-8ba5-8a88d77846a5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:14.670895 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-efc1497e-a479-4ecb-8ba5-8a88d77846a5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:14.671837 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-efc1497e-a479-4ecb-8ba5-8a88d77846a5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:14.672274 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-efc1497e-a479-4ecb-8ba5-8a88d77846a5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:14.739341 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-19ee290f-9a6b-4f12-a4a1-62dadf17b110 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Flavor limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:07:14.739880 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-19ee290f-9a6b-4f12-a4a1-62dadf17b110 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Image limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:07:14.740987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-19ee290f-9a6b-4f12-a4a1-62dadf17b110 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Flavor pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:07:14.741601 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-19ee290f-9a6b-4f12-a4a1-62dadf17b110 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Image pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:07:14.742018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-19ee290f-9a6b-4f12-a4a1-62dadf17b110 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:07:14.751015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-19ee290f-9a6b-4f12-a4a1-62dadf17b110 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:14.751498 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-19ee290f-9a6b-4f12-a4a1-62dadf17b110 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:14.752295 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-19ee290f-9a6b-4f12-a4a1-62dadf17b110 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:14.752731 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-19ee290f-9a6b-4f12-a4a1-62dadf17b110 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:14.769377 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-19ee290f-9a6b-4f12-a4a1-62dadf17b110 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Getting quotas for project 2940b81a86c2401db1aa432d9a0735eb. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:07:14.773549 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-19ee290f-9a6b-4f12-a4a1-62dadf17b110 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Getting quotas for user 0b8be0ab53ae48af844bc281dee5f77c and project 2940b81a86c2401db1aa432d9a0735eb. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:07:14.786072 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-19ee290f-9a6b-4f12-a4a1-62dadf17b110 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Going to run 1 instances... {{(pid=124589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:07:14.788343 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-19ee290f-9a6b-4f12-a4a1-62dadf17b110 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23371504-a4d6-4064-90b4-87bfd0a15170',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:07:14.811543 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-efc1497e-a479-4ecb-8ba5-8a88d77846a5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:14.819303 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-efc1497e-a479-4ecb-8ba5-8a88d77846a5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1266 microversion: 2.1 time: 0.160599 Jun 16 15:07:14.820095 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 550/1108] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:14 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:07:14.824682 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a3d59275-9238-4f36-a669-89cc702de254 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:14.825334 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a3d59275-9238-4f36-a669-89cc702de254 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:14.831829 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a3d59275-9238-4f36-a669-89cc702de254 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:14.832387 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a3d59275-9238-4f36-a669-89cc702de254 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:14.833227 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a3d59275-9238-4f36-a669-89cc702de254 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:14.833673 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a3d59275-9238-4f36-a669-89cc702de254 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:14.848387 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-19ee290f-9a6b-4f12-a4a1-62dadf17b110 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.602460 Jun 16 15:07:14.849292 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 559/1109] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 15:07:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 15:07:14.860879 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c24b6934-3f80-4658-8efd-be7e3b3199ba tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:14.861495 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c24b6934-3f80-4658-8efd-be7e3b3199ba tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:14.871655 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:14.935940 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c24b6934-3f80-4658-8efd-be7e3b3199ba tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:14.943614 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c24b6934-3f80-4658-8efd-be7e3b3199ba tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1241 microversion: 2.1 time: 0.087249 Jun 16 15:07:14.944548 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 560/1110] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:14 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:07:15.012189 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a3d59275-9238-4f36-a669-89cc702de254 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:15.023583 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a3d59275-9238-4f36-a669-89cc702de254 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:15.025709 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a3d59275-9238-4f36-a669-89cc702de254 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:15.026897 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a3d59275-9238-4f36-a669-89cc702de254 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.205891 Jun 16 15:07:15.027440 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 551/1111] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:14 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:15.836446 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-440c13cd-57ba-41f0-adb2-3053c6b0155c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:15.837085 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-440c13cd-57ba-41f0-adb2-3053c6b0155c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:15.843816 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-440c13cd-57ba-41f0-adb2-3053c6b0155c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:15.844273 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-440c13cd-57ba-41f0-adb2-3053c6b0155c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:15.845071 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-440c13cd-57ba-41f0-adb2-3053c6b0155c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:15.845519 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-440c13cd-57ba-41f0-adb2-3053c6b0155c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:15.961587 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0a380947-8a5b-44e8-a91f-1cb72beaf89d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:15.962195 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0a380947-8a5b-44e8-a91f-1cb72beaf89d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:15.965218 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:15.970659 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0a380947-8a5b-44e8-a91f-1cb72beaf89d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:15.971105 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0a380947-8a5b-44e8-a91f-1cb72beaf89d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:15.971865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0a380947-8a5b-44e8-a91f-1cb72beaf89d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:15.972295 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0a380947-8a5b-44e8-a91f-1cb72beaf89d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:15.983760 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-440c13cd-57ba-41f0-adb2-3053c6b0155c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:15.987532 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=6 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:15.992794 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-440c13cd-57ba-41f0-adb2-3053c6b0155c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1266 microversion: 2.1 time: 0.160154 Jun 16 15:07:15.993630 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 561/1112] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:15 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:16.045638 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0a380947-8a5b-44e8-a91f-1cb72beaf89d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:16.047867 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-cf7870fe-4464-40bc-98fa-3fa7fa021d34 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:16.048526 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-cf7870fe-4464-40bc-98fa-3fa7fa021d34 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:16.053370 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0a380947-8a5b-44e8-a91f-1cb72beaf89d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1293 microversion: 2.1 time: 0.095669 Jun 16 15:07:16.053952 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 552/1113] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:15 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:07:16.055996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cf7870fe-4464-40bc-98fa-3fa7fa021d34 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:16.057081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cf7870fe-4464-40bc-98fa-3fa7fa021d34 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:16.057838 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cf7870fe-4464-40bc-98fa-3fa7fa021d34 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:16.058273 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cf7870fe-4464-40bc-98fa-3fa7fa021d34 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:16.190166 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-cf7870fe-4464-40bc-98fa-3fa7fa021d34 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:16.199011 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-cf7870fe-4464-40bc-98fa-3fa7fa021d34 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:16.200509 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-cf7870fe-4464-40bc-98fa-3fa7fa021d34 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:16.201703 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-cf7870fe-4464-40bc-98fa-3fa7fa021d34 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.160502 Jun 16 15:07:16.202260 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 562/1114] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:16 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:07:17.009518 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4dce19fe-5b2e-4eed-8b7b-2e61a2e590a5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:17.010130 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4dce19fe-5b2e-4eed-8b7b-2e61a2e590a5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:17.016621 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4dce19fe-5b2e-4eed-8b7b-2e61a2e590a5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:17.017103 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4dce19fe-5b2e-4eed-8b7b-2e61a2e590a5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:17.017857 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4dce19fe-5b2e-4eed-8b7b-2e61a2e590a5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:17.018292 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4dce19fe-5b2e-4eed-8b7b-2e61a2e590a5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:17.070917 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9ffafdb4-addc-4f0e-ab2c-a6ae8df92b97 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:17.071612 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9ffafdb4-addc-4f0e-ab2c-a6ae8df92b97 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:17.078307 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ffafdb4-addc-4f0e-ab2c-a6ae8df92b97 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:17.079286 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ffafdb4-addc-4f0e-ab2c-a6ae8df92b97 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:17.079938 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ffafdb4-addc-4f0e-ab2c-a6ae8df92b97 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:17.080265 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ffafdb4-addc-4f0e-ab2c-a6ae8df92b97 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:17.156568 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9ffafdb4-addc-4f0e-ab2c-a6ae8df92b97 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:17.165011 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9ffafdb4-addc-4f0e-ab2c-a6ae8df92b97 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1299 microversion: 2.1 time: 0.097904 Jun 16 15:07:17.171734 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 563/1115] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:17 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:07:17.201750 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4dce19fe-5b2e-4eed-8b7b-2e61a2e590a5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:17.209680 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4dce19fe-5b2e-4eed-8b7b-2e61a2e590a5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1266 microversion: 2.1 time: 0.203956 Jun 16 15:07:17.210236 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 553/1116] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:17 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:17.358593 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f2f0f19d-f8af-4fbf-be0c-7a54b69b8805 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:17.359206 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f2f0f19d-f8af-4fbf-be0c-7a54b69b8805 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:17.365330 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f2f0f19d-f8af-4fbf-be0c-7a54b69b8805 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:17.365783 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f2f0f19d-f8af-4fbf-be0c-7a54b69b8805 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:17.366557 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f2f0f19d-f8af-4fbf-be0c-7a54b69b8805 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:17.366991 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f2f0f19d-f8af-4fbf-be0c-7a54b69b8805 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:17.501728 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f2f0f19d-f8af-4fbf-be0c-7a54b69b8805 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:17.510702 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f2f0f19d-f8af-4fbf-be0c-7a54b69b8805 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:17.512217 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f2f0f19d-f8af-4fbf-be0c-7a54b69b8805 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:17.513451 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f2f0f19d-f8af-4fbf-be0c-7a54b69b8805 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1742 microversion: 2.20 time: 0.297260 Jun 16 15:07:17.516874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 564/1117] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:17 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1742 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:18.183255 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e2e62648-c722-4fdb-a459-523a20f62ae3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:18.184210 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e2e62648-c722-4fdb-a459-523a20f62ae3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:18.191904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2e62648-c722-4fdb-a459-523a20f62ae3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:18.192619 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2e62648-c722-4fdb-a459-523a20f62ae3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:18.193878 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2e62648-c722-4fdb-a459-523a20f62ae3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:18.194479 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2e62648-c722-4fdb-a459-523a20f62ae3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:18.227089 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f36f55b8-96de-4dad-b4b3-5545ade11db4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:18.227800 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f36f55b8-96de-4dad-b4b3-5545ade11db4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:18.237186 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f36f55b8-96de-4dad-b4b3-5545ade11db4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:18.237668 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f36f55b8-96de-4dad-b4b3-5545ade11db4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:18.238470 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f36f55b8-96de-4dad-b4b3-5545ade11db4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:18.238915 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f36f55b8-96de-4dad-b4b3-5545ade11db4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:18.418571 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f36f55b8-96de-4dad-b4b3-5545ade11db4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:18.426934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f36f55b8-96de-4dad-b4b3-5545ade11db4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1266 microversion: 2.1 time: 0.203772 Jun 16 15:07:18.428981 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 565/1118] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:18 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:07:18.430418 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e2e62648-c722-4fdb-a459-523a20f62ae3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:18.443604 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e2e62648-c722-4fdb-a459-523a20f62ae3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1366 microversion: 2.1 time: 0.264714 Jun 16 15:07:18.445199 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 554/1119] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:18 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1366 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:18.532155 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1859432c-c54a-4e0a-8af9-f50c7b7f9b35 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:18.532926 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1859432c-c54a-4e0a-8af9-f50c7b7f9b35 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:18.539447 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1859432c-c54a-4e0a-8af9-f50c7b7f9b35 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:18.539907 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1859432c-c54a-4e0a-8af9-f50c7b7f9b35 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:18.540682 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1859432c-c54a-4e0a-8af9-f50c7b7f9b35 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:18.541147 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1859432c-c54a-4e0a-8af9-f50c7b7f9b35 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:18.580925 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-8d031606-befa-408c-94f3-d0a28817cf0e req-e9c8f4b6-3be7-4634-91e9-dbb8a5650cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fdfccb3-ca19-46af-91ee-db50006827ac", "tag": "c40f32fc-ed69-4d0e-ae9b-74cae93701f8"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:18.589453 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-8d031606-befa-408c-94f3-d0a28817cf0e req-e9c8f4b6-3be7-4634-91e9-dbb8a5650cd6 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:18.589912 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-8d031606-befa-408c-94f3-d0a28817cf0e req-e9c8f4b6-3be7-4634-91e9-dbb8a5650cd6 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:18.607255 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-8d031606-befa-408c-94f3-d0a28817cf0e req-e9c8f4b6-3be7-4634-91e9-dbb8a5650cd6 service nova] Creating event network-changed:c40f32fc-ed69-4d0e-ae9b-74cae93701f8 for instance 0fdfccb3-ca19-46af-91ee-db50006827ac on hv-cinder-83716 Jun 16 15:07:18.612768 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-8d031606-befa-408c-94f3-d0a28817cf0e req-e9c8f4b6-3be7-4634-91e9-dbb8a5650cd6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035419 Jun 16 15:07:18.613593 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 555/1120] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:07:18.703733 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1859432c-c54a-4e0a-8af9-f50c7b7f9b35 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:18.712515 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1859432c-c54a-4e0a-8af9-f50c7b7f9b35 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:18.715247 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1859432c-c54a-4e0a-8af9-f50c7b7f9b35 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:18.716502 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1859432c-c54a-4e0a-8af9-f50c7b7f9b35 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1742 microversion: 2.20 time: 0.188789 Jun 16 15:07:18.717193 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 566/1121] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:18 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1742 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:19.445572 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-92d24ec3-2ce3-4aac-acfb-7b97fb9f7f88 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:19.446180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-92d24ec3-2ce3-4aac-acfb-7b97fb9f7f88 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:19.448629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:19.454956 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-92d24ec3-2ce3-4aac-acfb-7b97fb9f7f88 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:19.455618 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-92d24ec3-2ce3-4aac-acfb-7b97fb9f7f88 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:19.456385 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-92d24ec3-2ce3-4aac-acfb-7b97fb9f7f88 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:19.456827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-92d24ec3-2ce3-4aac-acfb-7b97fb9f7f88 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:19.461827 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f0f73fed-e655-4a49-b1b2-ffb4e68b6331 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:19.462544 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f0f73fed-e655-4a49-b1b2-ffb4e68b6331 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:19.469727 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0f73fed-e655-4a49-b1b2-ffb4e68b6331 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:19.470215 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0f73fed-e655-4a49-b1b2-ffb4e68b6331 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:19.470985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0f73fed-e655-4a49-b1b2-ffb4e68b6331 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:19.471422 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0f73fed-e655-4a49-b1b2-ffb4e68b6331 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:19.620044 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f0f73fed-e655-4a49-b1b2-ffb4e68b6331 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:19.627899 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f0f73fed-e655-4a49-b1b2-ffb4e68b6331 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1366 microversion: 2.1 time: 0.169759 Jun 16 15:07:19.628481 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 567/1122] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:19 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:07:19.734887 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-566c4631-342c-4ef9-b2d0-54a2b4f51206 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:19.735531 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-566c4631-342c-4ef9-b2d0-54a2b4f51206 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:19.741752 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-566c4631-342c-4ef9-b2d0-54a2b4f51206 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:19.742285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-566c4631-342c-4ef9-b2d0-54a2b4f51206 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:19.743123 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-566c4631-342c-4ef9-b2d0-54a2b4f51206 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:19.743635 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-566c4631-342c-4ef9-b2d0-54a2b4f51206 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:19.846634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-92d24ec3-2ce3-4aac-acfb-7b97fb9f7f88 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:19.854353 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-92d24ec3-2ce3-4aac-acfb-7b97fb9f7f88 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1266 microversion: 2.1 time: 0.413627 Jun 16 15:07:19.855168 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 556/1123] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:19 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1266 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:19.878316 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-566c4631-342c-4ef9-b2d0-54a2b4f51206 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:19.881726 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:19.887591 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-566c4631-342c-4ef9-b2d0-54a2b4f51206 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:19.889117 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-566c4631-342c-4ef9-b2d0-54a2b4f51206 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:19.890334 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-566c4631-342c-4ef9-b2d0-54a2b4f51206 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1742 microversion: 2.20 time: 0.159527 Jun 16 15:07:19.890883 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 568/1124] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:19 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:07:20.350859 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-afd75f75-4dc1-49ed-95d0-f8dc2569fb16 req-216c95ba-8fe8-499d-a458-0c0151b212c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53e3fc3-e13f-4352-ad2f-7babd83b19e3", "name": "network-vif-plugged", "status": "completed", "tag": "2fd6981b-720b-4e5e-a50b-00f468402a5f"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:20.360082 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-afd75f75-4dc1-49ed-95d0-f8dc2569fb16 req-216c95ba-8fe8-499d-a458-0c0151b212c4 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:20.360720 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-afd75f75-4dc1-49ed-95d0-f8dc2569fb16 req-216c95ba-8fe8-499d-a458-0c0151b212c4 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:20.377567 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-afd75f75-4dc1-49ed-95d0-f8dc2569fb16 req-216c95ba-8fe8-499d-a458-0c0151b212c4 service nova] Creating event network-vif-plugged:2fd6981b-720b-4e5e-a50b-00f468402a5f for instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 on hv-cinder-83716 Jun 16 15:07:20.382822 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-afd75f75-4dc1-49ed-95d0-f8dc2569fb16 req-216c95ba-8fe8-499d-a458-0c0151b212c4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035689 Jun 16 15:07:20.383414 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 557/1125] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:07:20.646005 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-46970a07-5395-4a46-bd7b-80311f3f90a7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:20.646730 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-46970a07-5395-4a46-bd7b-80311f3f90a7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:20.653949 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-46970a07-5395-4a46-bd7b-80311f3f90a7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:20.654400 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-46970a07-5395-4a46-bd7b-80311f3f90a7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:20.655165 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-46970a07-5395-4a46-bd7b-80311f3f90a7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:20.655613 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-46970a07-5395-4a46-bd7b-80311f3f90a7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:20.790853 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-46970a07-5395-4a46-bd7b-80311f3f90a7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:20.799167 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-46970a07-5395-4a46-bd7b-80311f3f90a7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1366 microversion: 2.1 time: 0.157641 Jun 16 15:07:20.799732 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 569/1126] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:20 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:20.872717 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-08f18653-d7ef-4f05-93f4-022466eca6ce tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:20.873549 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-08f18653-d7ef-4f05-93f4-022466eca6ce tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:20.879926 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-08f18653-d7ef-4f05-93f4-022466eca6ce tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:20.880377 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-08f18653-d7ef-4f05-93f4-022466eca6ce tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:20.881167 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-08f18653-d7ef-4f05-93f4-022466eca6ce tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:20.881605 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-08f18653-d7ef-4f05-93f4-022466eca6ce tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:20.908611 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-896e7a4f-0aa5-4fd6-ace4-97ff9ef9cab1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:20.909407 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-896e7a4f-0aa5-4fd6-ace4-97ff9ef9cab1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:20.915675 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-896e7a4f-0aa5-4fd6-ace4-97ff9ef9cab1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:20.916211 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-896e7a4f-0aa5-4fd6-ace4-97ff9ef9cab1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:20.917082 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-896e7a4f-0aa5-4fd6-ace4-97ff9ef9cab1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:20.917518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-896e7a4f-0aa5-4fd6-ace4-97ff9ef9cab1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:21.050979 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-896e7a4f-0aa5-4fd6-ace4-97ff9ef9cab1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:21.059063 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-896e7a4f-0aa5-4fd6-ace4-97ff9ef9cab1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:21.060573 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-896e7a4f-0aa5-4fd6-ace4-97ff9ef9cab1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:21.061791 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-896e7a4f-0aa5-4fd6-ace4-97ff9ef9cab1 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1742 microversion: 2.20 time: 0.157700 Jun 16 15:07:21.062377 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 570/1127] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:20 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:07:21.104155 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-08f18653-d7ef-4f05-93f4-022466eca6ce tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:21.111686 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-08f18653-d7ef-4f05-93f4-022466eca6ce tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1266 microversion: 2.1 time: 0.243703 Jun 16 15:07:21.112322 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 558/1128] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:20 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:21.816113 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1757eb4d-951a-4b59-a588-cb73d802a2da tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:21.816722 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1757eb4d-951a-4b59-a588-cb73d802a2da tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:21.823206 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1757eb4d-951a-4b59-a588-cb73d802a2da tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:21.823648 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1757eb4d-951a-4b59-a588-cb73d802a2da tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:21.824400 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1757eb4d-951a-4b59-a588-cb73d802a2da tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:21.824823 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1757eb4d-951a-4b59-a588-cb73d802a2da tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:21.951319 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1757eb4d-951a-4b59-a588-cb73d802a2da tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:21.958694 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1757eb4d-951a-4b59-a588-cb73d802a2da tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1366 microversion: 2.1 time: 0.146443 Jun 16 15:07:21.959259 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 571/1129] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:21 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:22.080248 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e547b137-13f7-4913-9a01-05a54164119d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:22.080785 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e547b137-13f7-4913-9a01-05a54164119d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:22.087337 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e547b137-13f7-4913-9a01-05a54164119d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:22.087790 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e547b137-13f7-4913-9a01-05a54164119d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:22.089091 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e547b137-13f7-4913-9a01-05a54164119d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:22.089530 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e547b137-13f7-4913-9a01-05a54164119d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:22.128439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2a6a4359-fa4a-44eb-89ae-d55169cc5ba5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:22.129091 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2a6a4359-fa4a-44eb-89ae-d55169cc5ba5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:22.135103 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a6a4359-fa4a-44eb-89ae-d55169cc5ba5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:22.135571 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a6a4359-fa4a-44eb-89ae-d55169cc5ba5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:22.136331 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a6a4359-fa4a-44eb-89ae-d55169cc5ba5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:22.136766 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a6a4359-fa4a-44eb-89ae-d55169cc5ba5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:22.227927 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e547b137-13f7-4913-9a01-05a54164119d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:22.237262 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e547b137-13f7-4913-9a01-05a54164119d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:22.238789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e547b137-13f7-4913-9a01-05a54164119d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:22.240340 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e547b137-13f7-4913-9a01-05a54164119d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1742 microversion: 2.20 time: 0.164126 Jun 16 15:07:22.240908 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 559/1130] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:22 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:22.279718 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2a6a4359-fa4a-44eb-89ae-d55169cc5ba5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:22.287539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2a6a4359-fa4a-44eb-89ae-d55169cc5ba5 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1266 microversion: 2.1 time: 0.162826 Jun 16 15:07:22.288271 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 572/1131] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:22 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:07:22.975356 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-274b2069-e03c-4e5d-b806-86f0a18ee3c9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:22.975976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-274b2069-e03c-4e5d-b806-86f0a18ee3c9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:22.982060 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-274b2069-e03c-4e5d-b806-86f0a18ee3c9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:22.982518 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-274b2069-e03c-4e5d-b806-86f0a18ee3c9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:22.983288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-274b2069-e03c-4e5d-b806-86f0a18ee3c9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:22.983728 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-274b2069-e03c-4e5d-b806-86f0a18ee3c9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:23.111938 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-274b2069-e03c-4e5d-b806-86f0a18ee3c9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:23.119385 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-274b2069-e03c-4e5d-b806-86f0a18ee3c9 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1366 microversion: 2.1 time: 0.147844 Jun 16 15:07:23.120591 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 560/1132] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:22 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:23.258426 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-99fe602a-f8a6-4891-a841-dbe6ded3cbb8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:23.258995 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-99fe602a-f8a6-4891-a841-dbe6ded3cbb8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:23.265644 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-99fe602a-f8a6-4891-a841-dbe6ded3cbb8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:23.266095 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-99fe602a-f8a6-4891-a841-dbe6ded3cbb8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:23.266859 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-99fe602a-f8a6-4891-a841-dbe6ded3cbb8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:23.267300 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-99fe602a-f8a6-4891-a841-dbe6ded3cbb8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:23.304692 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-97a3d921-800b-4d82-883a-ede8b5943fa6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:23.305422 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-97a3d921-800b-4d82-883a-ede8b5943fa6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:23.312480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-97a3d921-800b-4d82-883a-ede8b5943fa6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:23.313051 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-97a3d921-800b-4d82-883a-ede8b5943fa6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:23.313892 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-97a3d921-800b-4d82-883a-ede8b5943fa6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:23.314400 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-97a3d921-800b-4d82-883a-ede8b5943fa6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:23.406353 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-99fe602a-f8a6-4891-a841-dbe6ded3cbb8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:23.414854 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-99fe602a-f8a6-4891-a841-dbe6ded3cbb8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:23.416378 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-99fe602a-f8a6-4891-a841-dbe6ded3cbb8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:23.418178 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-99fe602a-f8a6-4891-a841-dbe6ded3cbb8 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1742 microversion: 2.20 time: 0.163746 Jun 16 15:07:23.418942 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 573/1133] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:23 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1742 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:23.461801 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-97a3d921-800b-4d82-883a-ede8b5943fa6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:23.469293 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-97a3d921-800b-4d82-883a-ede8b5943fa6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1266 microversion: 2.1 time: 0.168474 Jun 16 15:07:23.471562 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 561/1134] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:23 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:07:24.137093 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ec2ea6af-1870-451e-8831-15f651e975ec tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:24.137646 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ec2ea6af-1870-451e-8831-15f651e975ec tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:24.143747 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ec2ea6af-1870-451e-8831-15f651e975ec tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:24.144202 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ec2ea6af-1870-451e-8831-15f651e975ec tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:24.144995 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ec2ea6af-1870-451e-8831-15f651e975ec tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:24.145435 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ec2ea6af-1870-451e-8831-15f651e975ec tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:24.277243 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ec2ea6af-1870-451e-8831-15f651e975ec tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:24.284874 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ec2ea6af-1870-451e-8831-15f651e975ec tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1366 microversion: 2.1 time: 0.152284 Jun 16 15:07:24.285438 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 574/1135] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:24 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:24.436005 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-52ef48f2-4db9-4aa5-9457-64ed3dfe541d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:24.436742 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-52ef48f2-4db9-4aa5-9457-64ed3dfe541d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:24.442913 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-52ef48f2-4db9-4aa5-9457-64ed3dfe541d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:24.443371 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-52ef48f2-4db9-4aa5-9457-64ed3dfe541d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:24.444139 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-52ef48f2-4db9-4aa5-9457-64ed3dfe541d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:24.444580 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-52ef48f2-4db9-4aa5-9457-64ed3dfe541d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:24.486503 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e1b52a53-f83d-497c-930a-3a32825b0f86 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:24.487146 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e1b52a53-f83d-497c-930a-3a32825b0f86 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:24.493624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e1b52a53-f83d-497c-930a-3a32825b0f86 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:24.494074 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e1b52a53-f83d-497c-930a-3a32825b0f86 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:24.495375 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e1b52a53-f83d-497c-930a-3a32825b0f86 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:24.495805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e1b52a53-f83d-497c-930a-3a32825b0f86 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:24.578598 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-52ef48f2-4db9-4aa5-9457-64ed3dfe541d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:24.586849 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-52ef48f2-4db9-4aa5-9457-64ed3dfe541d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:24.588367 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-52ef48f2-4db9-4aa5-9457-64ed3dfe541d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:24.589739 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-52ef48f2-4db9-4aa5-9457-64ed3dfe541d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1742 microversion: 2.20 time: 0.158189 Jun 16 15:07:24.590305 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 562/1136] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:24 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:24.631495 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e1b52a53-f83d-497c-930a-3a32825b0f86 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:24.638895 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e1b52a53-f83d-497c-930a-3a32825b0f86 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1266 microversion: 2.1 time: 0.156250 Jun 16 15:07:24.639516 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 575/1137] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:24 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:07:25.301972 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3e80af13-f1ba-4036-9132-5139646b6937 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:25.302594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3e80af13-f1ba-4036-9132-5139646b6937 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:25.309653 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e80af13-f1ba-4036-9132-5139646b6937 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:25.310137 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e80af13-f1ba-4036-9132-5139646b6937 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:25.310938 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e80af13-f1ba-4036-9132-5139646b6937 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:25.311369 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e80af13-f1ba-4036-9132-5139646b6937 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:25.442227 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3e80af13-f1ba-4036-9132-5139646b6937 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:25.450904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3e80af13-f1ba-4036-9132-5139646b6937 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1366 microversion: 2.1 time: 0.153064 Jun 16 15:07:25.451480 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 563/1138] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:25 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:25.507045 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-76f529c3-b5c7-49ab-8177-3486d5ee211b req-955de958-dd01-4c2b-9381-0dbd448136cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "396d3e73-5c6a-4889-84e6-7a440d744018", "name": "network-vif-plugged", "status": "completed", "tag": "4dcaa0bd-2a2c-4ab0-8ae1-a7aca82c5393"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:25.510514 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:25.511210 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=18 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:25.517632 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-76f529c3-b5c7-49ab-8177-3486d5ee211b req-955de958-dd01-4c2b-9381-0dbd448136cb service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:25.518074 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-76f529c3-b5c7-49ab-8177-3486d5ee211b req-955de958-dd01-4c2b-9381-0dbd448136cb service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:25.530007 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-76f529c3-b5c7-49ab-8177-3486d5ee211b req-955de958-dd01-4c2b-9381-0dbd448136cb service nova] Creating event network-vif-plugged:4dcaa0bd-2a2c-4ab0-8ae1-a7aca82c5393 for instance 396d3e73-5c6a-4889-84e6-7a440d744018 on hv-cinder-83716 Jun 16 15:07:25.536246 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-76f529c3-b5c7-49ab-8177-3486d5ee211b req-955de958-dd01-4c2b-9381-0dbd448136cb service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032811 Jun 16 15:07:25.536881 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 576/1139] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:07:25.608196 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0340c340-2772-4164-ae27-83c05f5026eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:25.608812 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0340c340-2772-4164-ae27-83c05f5026eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:25.615154 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0340c340-2772-4164-ae27-83c05f5026eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:25.615614 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0340c340-2772-4164-ae27-83c05f5026eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:25.616386 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0340c340-2772-4164-ae27-83c05f5026eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:25.616830 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0340c340-2772-4164-ae27-83c05f5026eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:25.656036 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4330c1eb-f3cc-4805-9584-ef39896c0a78 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:25.656732 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4330c1eb-f3cc-4805-9584-ef39896c0a78 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:25.663297 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4330c1eb-f3cc-4805-9584-ef39896c0a78 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:25.663752 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4330c1eb-f3cc-4805-9584-ef39896c0a78 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:25.664520 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4330c1eb-f3cc-4805-9584-ef39896c0a78 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:25.664985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4330c1eb-f3cc-4805-9584-ef39896c0a78 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:25.750739 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0340c340-2772-4164-ae27-83c05f5026eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:25.758734 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0340c340-2772-4164-ae27-83c05f5026eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:25.760468 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0340c340-2772-4164-ae27-83c05f5026eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:25.761646 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0340c340-2772-4164-ae27-83c05f5026eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1742 microversion: 2.20 time: 0.158038 Jun 16 15:07:25.762201 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 564/1140] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:25 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:25.799332 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4330c1eb-f3cc-4805-9584-ef39896c0a78 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:25.806784 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4330c1eb-f3cc-4805-9584-ef39896c0a78 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1266 microversion: 2.1 time: 0.155003 Jun 16 15:07:25.807397 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 577/1141] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:25 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:07:26.468884 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0afb3fbf-2d4a-49d2-a5bb-b2738f744ee7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:26.469510 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0afb3fbf-2d4a-49d2-a5bb-b2738f744ee7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:26.476161 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0afb3fbf-2d4a-49d2-a5bb-b2738f744ee7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:26.476620 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0afb3fbf-2d4a-49d2-a5bb-b2738f744ee7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:26.477413 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0afb3fbf-2d4a-49d2-a5bb-b2738f744ee7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:26.477861 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0afb3fbf-2d4a-49d2-a5bb-b2738f744ee7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:26.608678 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0afb3fbf-2d4a-49d2-a5bb-b2738f744ee7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:26.616161 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0afb3fbf-2d4a-49d2-a5bb-b2738f744ee7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1366 microversion: 2.1 time: 0.151341 Jun 16 15:07:26.616728 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 565/1142] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:26 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:26.779765 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e9003da6-4e79-46da-9feb-bda962fe7a96 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:26.780315 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e9003da6-4e79-46da-9feb-bda962fe7a96 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:26.787268 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e9003da6-4e79-46da-9feb-bda962fe7a96 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:26.787716 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e9003da6-4e79-46da-9feb-bda962fe7a96 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:26.788493 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e9003da6-4e79-46da-9feb-bda962fe7a96 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:26.788962 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e9003da6-4e79-46da-9feb-bda962fe7a96 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:26.823970 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-427b6469-2114-4f74-8da9-e92b509ac08c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:26.824585 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-427b6469-2114-4f74-8da9-e92b509ac08c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:26.830835 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-427b6469-2114-4f74-8da9-e92b509ac08c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:26.831300 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-427b6469-2114-4f74-8da9-e92b509ac08c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:26.832085 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-427b6469-2114-4f74-8da9-e92b509ac08c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:26.832528 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-427b6469-2114-4f74-8da9-e92b509ac08c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:26.836671 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:26.922447 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e9003da6-4e79-46da-9feb-bda962fe7a96 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:26.930341 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e9003da6-4e79-46da-9feb-bda962fe7a96 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:26.931826 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e9003da6-4e79-46da-9feb-bda962fe7a96 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:26.933651 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e9003da6-4e79-46da-9feb-bda962fe7a96 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1742 microversion: 2.20 time: 0.158016 Jun 16 15:07:26.934201 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 578/1143] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:26 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:26.966971 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-427b6469-2114-4f74-8da9-e92b509ac08c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:26.974577 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-427b6469-2114-4f74-8da9-e92b509ac08c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1266 microversion: 2.1 time: 0.155039 Jun 16 15:07:26.975138 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 566/1144] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:26 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:07:27.699062 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1003265f-8e98-43eb-9fba-7f3d5f5189ec tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:27.699832 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1003265f-8e98-43eb-9fba-7f3d5f5189ec tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:27.706925 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1003265f-8e98-43eb-9fba-7f3d5f5189ec tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:27.707382 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1003265f-8e98-43eb-9fba-7f3d5f5189ec tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:27.708156 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1003265f-8e98-43eb-9fba-7f3d5f5189ec tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:27.708595 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1003265f-8e98-43eb-9fba-7f3d5f5189ec tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:27.834900 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1003265f-8e98-43eb-9fba-7f3d5f5189ec tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:27.842942 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1003265f-8e98-43eb-9fba-7f3d5f5189ec tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1366 microversion: 2.1 time: 0.213081 Jun 16 15:07:27.843509 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 579/1145] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:27 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:27.952346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-db2ef7b5-4564-4513-9a92-2a7de67791c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:27.952928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-db2ef7b5-4564-4513-9a92-2a7de67791c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:27.959483 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-db2ef7b5-4564-4513-9a92-2a7de67791c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:27.959940 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-db2ef7b5-4564-4513-9a92-2a7de67791c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:27.960711 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-db2ef7b5-4564-4513-9a92-2a7de67791c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:27.961199 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-db2ef7b5-4564-4513-9a92-2a7de67791c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:27.991341 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c22e02ce-023b-4828-b792-ac718805fbc6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:27.991958 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c22e02ce-023b-4828-b792-ac718805fbc6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:27.999176 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c22e02ce-023b-4828-b792-ac718805fbc6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:27.999632 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c22e02ce-023b-4828-b792-ac718805fbc6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:28.000403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c22e02ce-023b-4828-b792-ac718805fbc6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:28.000868 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c22e02ce-023b-4828-b792-ac718805fbc6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:28.095170 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-db2ef7b5-4564-4513-9a92-2a7de67791c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:28.103221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-db2ef7b5-4564-4513-9a92-2a7de67791c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:28.104734 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-db2ef7b5-4564-4513-9a92-2a7de67791c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:28.105945 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-db2ef7b5-4564-4513-9a92-2a7de67791c7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1742 microversion: 2.20 time: 0.158331 Jun 16 15:07:28.106502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 567/1146] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:27 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:28.134107 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c22e02ce-023b-4828-b792-ac718805fbc6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:28.142214 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c22e02ce-023b-4828-b792-ac718805fbc6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1266 microversion: 2.1 time: 0.154665 Jun 16 15:07:28.142778 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 580/1147] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:27 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:07:28.860390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-11ae51ee-de44-4e93-b915-d320c9d919a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:28.860944 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-11ae51ee-de44-4e93-b915-d320c9d919a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:28.867030 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-11ae51ee-de44-4e93-b915-d320c9d919a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:28.867490 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-11ae51ee-de44-4e93-b915-d320c9d919a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:28.868245 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-11ae51ee-de44-4e93-b915-d320c9d919a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:28.868681 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-11ae51ee-de44-4e93-b915-d320c9d919a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:28.995923 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-11ae51ee-de44-4e93-b915-d320c9d919a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:29.003390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-11ae51ee-de44-4e93-b915-d320c9d919a3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1366 microversion: 2.1 time: 0.146986 Jun 16 15:07:29.003948 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 568/1148] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:28 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:29.123457 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5006a432-f96b-4f25-bcad-4042781b2521 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:29.123999 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5006a432-f96b-4f25-bcad-4042781b2521 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:29.130606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5006a432-f96b-4f25-bcad-4042781b2521 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:29.131084 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5006a432-f96b-4f25-bcad-4042781b2521 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:29.131847 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5006a432-f96b-4f25-bcad-4042781b2521 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:29.132300 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5006a432-f96b-4f25-bcad-4042781b2521 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:29.158996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d9e5f9e9-94f8-49bf-b629-54af35655507 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:29.159607 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d9e5f9e9-94f8-49bf-b629-54af35655507 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:29.165716 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d9e5f9e9-94f8-49bf-b629-54af35655507 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:29.166169 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d9e5f9e9-94f8-49bf-b629-54af35655507 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:29.166937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d9e5f9e9-94f8-49bf-b629-54af35655507 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:29.167378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d9e5f9e9-94f8-49bf-b629-54af35655507 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:29.263104 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5006a432-f96b-4f25-bcad-4042781b2521 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:29.271056 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5006a432-f96b-4f25-bcad-4042781b2521 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:29.272554 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5006a432-f96b-4f25-bcad-4042781b2521 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:29.273749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5006a432-f96b-4f25-bcad-4042781b2521 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1742 microversion: 2.20 time: 0.154354 Jun 16 15:07:29.274314 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 581/1149] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:29 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:29.299577 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d9e5f9e9-94f8-49bf-b629-54af35655507 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:29.307028 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d9e5f9e9-94f8-49bf-b629-54af35655507 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1266 microversion: 2.1 time: 0.152220 Jun 16 15:07:29.307583 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 569/1150] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:29 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:07:30.019388 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-806d4cba-c9cf-4cc0-b0ea-a2b2ab8c8211 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:30.020045 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-806d4cba-c9cf-4cc0-b0ea-a2b2ab8c8211 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:30.026582 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-806d4cba-c9cf-4cc0-b0ea-a2b2ab8c8211 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:30.027035 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-806d4cba-c9cf-4cc0-b0ea-a2b2ab8c8211 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:30.027798 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-806d4cba-c9cf-4cc0-b0ea-a2b2ab8c8211 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:30.028243 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-806d4cba-c9cf-4cc0-b0ea-a2b2ab8c8211 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:30.159456 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-806d4cba-c9cf-4cc0-b0ea-a2b2ab8c8211 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:30.167047 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-806d4cba-c9cf-4cc0-b0ea-a2b2ab8c8211 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1366 microversion: 2.1 time: 0.151543 Jun 16 15:07:30.168308 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 582/1151] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:30 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:30.293712 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e61ed6c1-8c84-4cfe-b92e-59f6f67dd9a2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:30.294288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-2c543e31-2f69-4ced-a86f-e2fbd8b33c62 req-9ba93721-afe9-486b-9df6-0b5b7a8277b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdfccb3-ca19-46af-91ee-db50006827ac", "name": "network-vif-plugged", "status": "completed", "tag": "c40f32fc-ed69-4d0e-ae9b-74cae93701f8"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:30.294585 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e61ed6c1-8c84-4cfe-b92e-59f6f67dd9a2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:30.301763 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e61ed6c1-8c84-4cfe-b92e-59f6f67dd9a2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:30.302197 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e61ed6c1-8c84-4cfe-b92e-59f6f67dd9a2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:30.302969 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e61ed6c1-8c84-4cfe-b92e-59f6f67dd9a2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:30.303541 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e61ed6c1-8c84-4cfe-b92e-59f6f67dd9a2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:30.304424 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-2c543e31-2f69-4ced-a86f-e2fbd8b33c62 req-9ba93721-afe9-486b-9df6-0b5b7a8277b4 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:30.305110 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-2c543e31-2f69-4ced-a86f-e2fbd8b33c62 req-9ba93721-afe9-486b-9df6-0b5b7a8277b4 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:30.323147 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-2c543e31-2f69-4ced-a86f-e2fbd8b33c62 req-9ba93721-afe9-486b-9df6-0b5b7a8277b4 service nova] Creating event network-vif-plugged:c40f32fc-ed69-4d0e-ae9b-74cae93701f8 for instance 0fdfccb3-ca19-46af-91ee-db50006827ac on hv-cinder-83716 Jun 16 15:07:30.328273 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-2c543e31-2f69-4ced-a86f-e2fbd8b33c62 req-9ba93721-afe9-486b-9df6-0b5b7a8277b4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038443 Jun 16 15:07:30.329422 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 583/1152] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:30.334487 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8c267057-8949-4a74-a578-9672ca78e117 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:30.335188 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8c267057-8949-4a74-a578-9672ca78e117 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:30.341965 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c267057-8949-4a74-a578-9672ca78e117 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:30.342814 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c267057-8949-4a74-a578-9672ca78e117 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:30.343172 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c267057-8949-4a74-a578-9672ca78e117 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:30.343606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c267057-8949-4a74-a578-9672ca78e117 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:30.443987 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e61ed6c1-8c84-4cfe-b92e-59f6f67dd9a2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:30.451954 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e61ed6c1-8c84-4cfe-b92e-59f6f67dd9a2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:30.453627 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e61ed6c1-8c84-4cfe-b92e-59f6f67dd9a2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:30.454790 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e61ed6c1-8c84-4cfe-b92e-59f6f67dd9a2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1737 microversion: 2.20 time: 0.165929 Jun 16 15:07:30.455432 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 570/1153] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:30 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:30.481625 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8c267057-8949-4a74-a578-9672ca78e117 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:30.489025 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8c267057-8949-4a74-a578-9672ca78e117 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1266 microversion: 2.1 time: 0.158474 Jun 16 15:07:30.489587 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 584/1154] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:30 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:31.185747 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5c82c06d-1365-4bad-ac32-d8c5661a0144 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:31.186629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5c82c06d-1365-4bad-ac32-d8c5661a0144 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:31.193502 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5c82c06d-1365-4bad-ac32-d8c5661a0144 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:31.194041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5c82c06d-1365-4bad-ac32-d8c5661a0144 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:31.195040 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5c82c06d-1365-4bad-ac32-d8c5661a0144 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:31.195721 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5c82c06d-1365-4bad-ac32-d8c5661a0144 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:31.353290 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5c82c06d-1365-4bad-ac32-d8c5661a0144 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:31.362839 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5c82c06d-1365-4bad-ac32-d8c5661a0144 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1366 microversion: 2.1 time: 0.181839 Jun 16 15:07:31.363435 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 571/1155] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:31 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:31.474347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f72dbf55-8f03-434c-b7a3-e67410836cdb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:31.475094 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f72dbf55-8f03-434c-b7a3-e67410836cdb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:31.482529 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f72dbf55-8f03-434c-b7a3-e67410836cdb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:31.482976 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f72dbf55-8f03-434c-b7a3-e67410836cdb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:31.483992 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f72dbf55-8f03-434c-b7a3-e67410836cdb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:31.484429 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f72dbf55-8f03-434c-b7a3-e67410836cdb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:31.505739 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d2f07707-13bc-4b4d-9d99-817c36dfaa1e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:31.506457 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d2f07707-13bc-4b4d-9d99-817c36dfaa1e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:31.512580 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2f07707-13bc-4b4d-9d99-817c36dfaa1e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:31.513144 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2f07707-13bc-4b4d-9d99-817c36dfaa1e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:31.513976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2f07707-13bc-4b4d-9d99-817c36dfaa1e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:31.514501 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2f07707-13bc-4b4d-9d99-817c36dfaa1e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:31.634247 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f72dbf55-8f03-434c-b7a3-e67410836cdb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:31.643326 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f72dbf55-8f03-434c-b7a3-e67410836cdb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:31.645274 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f72dbf55-8f03-434c-b7a3-e67410836cdb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:31.646671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f72dbf55-8f03-434c-b7a3-e67410836cdb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1737 microversion: 2.20 time: 0.176324 Jun 16 15:07:31.647413 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 585/1156] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:31 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:31.668253 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d2f07707-13bc-4b4d-9d99-817c36dfaa1e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:31.676629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d2f07707-13bc-4b4d-9d99-817c36dfaa1e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1453 microversion: 2.1 time: 0.174718 Jun 16 15:07:31.688080 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 572/1157] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:31 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:07:31.693304 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-be08eb0f-d826-45f4-bd75-5d83768e6bb6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:31.693912 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-be08eb0f-d826-45f4-bd75-5d83768e6bb6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:31.700341 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-be08eb0f-d826-45f4-bd75-5d83768e6bb6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:31.700786 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-be08eb0f-d826-45f4-bd75-5d83768e6bb6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:31.701567 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-be08eb0f-d826-45f4-bd75-5d83768e6bb6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:31.701993 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-be08eb0f-d826-45f4-bd75-5d83768e6bb6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:31.875324 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-be08eb0f-d826-45f4-bd75-5d83768e6bb6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:31.879967 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:31.890220 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-be08eb0f-d826-45f4-bd75-5d83768e6bb6 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1453 microversion: 2.1 time: 0.200533 Jun 16 15:07:31.890898 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 586/1158] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:31 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1453 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:07:32.382828 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5ed1da08-23d1-49ba-8222-a6cdab46f5e7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:32.384153 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5ed1da08-23d1-49ba-8222-a6cdab46f5e7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:32.390830 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5ed1da08-23d1-49ba-8222-a6cdab46f5e7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:32.391876 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5ed1da08-23d1-49ba-8222-a6cdab46f5e7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:32.393150 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5ed1da08-23d1-49ba-8222-a6cdab46f5e7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:32.393812 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5ed1da08-23d1-49ba-8222-a6cdab46f5e7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:32.665168 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3afb92fa-5490-4aba-b97c-572354f65162 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:32.665775 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3afb92fa-5490-4aba-b97c-572354f65162 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:32.673402 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3afb92fa-5490-4aba-b97c-572354f65162 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:32.673528 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3afb92fa-5490-4aba-b97c-572354f65162 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:32.674265 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3afb92fa-5490-4aba-b97c-572354f65162 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:32.674956 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3afb92fa-5490-4aba-b97c-572354f65162 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:32.675675 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5ed1da08-23d1-49ba-8222-a6cdab46f5e7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:32.688331 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5ed1da08-23d1-49ba-8222-a6cdab46f5e7 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1366 microversion: 2.1 time: 0.310363 Jun 16 15:07:32.690460 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 573/1159] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:32 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:32.888187 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3afb92fa-5490-4aba-b97c-572354f65162 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:32.896471 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3afb92fa-5490-4aba-b97c-572354f65162 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:32.897939 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3afb92fa-5490-4aba-b97c-572354f65162 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:32.899119 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3afb92fa-5490-4aba-b97c-572354f65162 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1737 microversion: 2.20 time: 0.238704 Jun 16 15:07:32.899674 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 587/1160] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:32 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1737 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:33.706646 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8a2c0622-3ce4-4e68-bc1d-eaa59a40b17d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:33.708096 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8a2c0622-3ce4-4e68-bc1d-eaa59a40b17d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:33.714828 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a2c0622-3ce4-4e68-bc1d-eaa59a40b17d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:33.717964 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a2c0622-3ce4-4e68-bc1d-eaa59a40b17d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:33.719338 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a2c0622-3ce4-4e68-bc1d-eaa59a40b17d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:33.720054 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a2c0622-3ce4-4e68-bc1d-eaa59a40b17d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:33.923934 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-94b06d21-ad9b-4507-b284-b6966d7cdad2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:33.925594 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-94b06d21-ad9b-4507-b284-b6966d7cdad2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:33.937280 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-94b06d21-ad9b-4507-b284-b6966d7cdad2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:33.937957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-94b06d21-ad9b-4507-b284-b6966d7cdad2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:33.938910 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-94b06d21-ad9b-4507-b284-b6966d7cdad2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:33.939510 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-94b06d21-ad9b-4507-b284-b6966d7cdad2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:33.981584 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8a2c0622-3ce4-4e68-bc1d-eaa59a40b17d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:33.990072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8a2c0622-3ce4-4e68-bc1d-eaa59a40b17d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1366 microversion: 2.1 time: 0.287547 Jun 16 15:07:33.991765 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 574/1161] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:33 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:34.129843 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-b0c62ecd-cd28-4182-99cc-a6e8eaf23893 req-0467e4f5-c01f-45d7-bb94-7217b97b0c2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "396d3e73-5c6a-4889-84e6-7a440d744018", "tag": "4dcaa0bd-2a2c-4ab0-8ae1-a7aca82c5393"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:34.139589 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-b0c62ecd-cd28-4182-99cc-a6e8eaf23893 req-0467e4f5-c01f-45d7-bb94-7217b97b0c2c service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:34.140463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-b0c62ecd-cd28-4182-99cc-a6e8eaf23893 req-0467e4f5-c01f-45d7-bb94-7217b97b0c2c service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:34.155748 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-b0c62ecd-cd28-4182-99cc-a6e8eaf23893 req-0467e4f5-c01f-45d7-bb94-7217b97b0c2c service nova] Creating event network-changed:4dcaa0bd-2a2c-4ab0-8ae1-a7aca82c5393 for instance 396d3e73-5c6a-4889-84e6-7a440d744018 on hv-cinder-83716 Jun 16 15:07:34.174113 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-b0c62ecd-cd28-4182-99cc-a6e8eaf23893 req-0467e4f5-c01f-45d7-bb94-7217b97b0c2c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047747 Jun 16 15:07:34.178224 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 575/1162] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:34.186105 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-94b06d21-ad9b-4507-b284-b6966d7cdad2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:34.194667 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-94b06d21-ad9b-4507-b284-b6966d7cdad2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:34.197632 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-94b06d21-ad9b-4507-b284-b6966d7cdad2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:34.199143 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-94b06d21-ad9b-4507-b284-b6966d7cdad2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1737 microversion: 2.20 time: 0.284806 Jun 16 15:07:34.209291 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 588/1163] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:33 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1737 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:35.008562 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bd9fa169-5a33-40c7-b25f-970d8193b178 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:35.009298 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bd9fa169-5a33-40c7-b25f-970d8193b178 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:35.020872 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bd9fa169-5a33-40c7-b25f-970d8193b178 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:35.024130 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bd9fa169-5a33-40c7-b25f-970d8193b178 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:35.025194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bd9fa169-5a33-40c7-b25f-970d8193b178 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:35.028745 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bd9fa169-5a33-40c7-b25f-970d8193b178 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:35.095411 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-786b791b-2a58-4dcc-99bc-25370b8f7016 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2032152805", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1156471918", "security_groups": [{"name": "tempest-secgroup-smoke-1610352097"}], "networks": [{"uuid": "4bbbab54-6102-4eef-ada6-8ad180c2f233"}], "block_device_mapping_v2": [{"uuid": "6e0e2fbf-1930-4374-bce1-af59502b44d0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:35.212791 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bd9fa169-5a33-40c7-b25f-970d8193b178 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:35.228044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bd9fa169-5a33-40c7-b25f-970d8193b178 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1556 microversion: 2.1 time: 0.223778 Jun 16 15:07:35.240601 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 576/1164] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:35 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1556 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:35.246787 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-49dbf9d1-7884-48f5-81a2-eef303347d7c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:35.247680 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-49dbf9d1-7884-48f5-81a2-eef303347d7c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:35.254314 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-49dbf9d1-7884-48f5-81a2-eef303347d7c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:35.255043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-49dbf9d1-7884-48f5-81a2-eef303347d7c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:35.256006 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-49dbf9d1-7884-48f5-81a2-eef303347d7c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:35.256611 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-49dbf9d1-7884-48f5-81a2-eef303347d7c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:35.261360 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.network.neutron [None req-786b791b-2a58-4dcc-99bc-25370b8f7016 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] validate_networks() for [('4bbbab54-6102-4eef-ada6-8ad180c2f233', None, None, None, None, None)] {{(pid=124589) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:07:35.451651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-49dbf9d1-7884-48f5-81a2-eef303347d7c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:35.469110 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-49dbf9d1-7884-48f5-81a2-eef303347d7c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:35.473104 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-49dbf9d1-7884-48f5-81a2-eef303347d7c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:35.474319 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-49dbf9d1-7884-48f5-81a2-eef303347d7c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1737 microversion: 2.20 time: 0.232313 Jun 16 15:07:35.487086 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 577/1165] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:35 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1737 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:35.496615 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8453f026-065b-4150-b2bb-34fdd2a06d24 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:35.497136 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8453f026-065b-4150-b2bb-34fdd2a06d24 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:35.503616 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8453f026-065b-4150-b2bb-34fdd2a06d24 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:35.504065 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8453f026-065b-4150-b2bb-34fdd2a06d24 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:35.504874 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8453f026-065b-4150-b2bb-34fdd2a06d24 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:35.505348 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8453f026-065b-4150-b2bb-34fdd2a06d24 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:35.611205 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8453f026-065b-4150-b2bb-34fdd2a06d24 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122892 Jun 16 15:07:35.612209 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 578/1166] 10.222.0.72 () {58 vars in 1274 bytes} [Thu Jun 16 15:07:35 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:35.802117 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-786b791b-2a58-4dcc-99bc-25370b8f7016 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Flavor limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:07:35.802890 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-786b791b-2a58-4dcc-99bc-25370b8f7016 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Image limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:07:35.803654 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-786b791b-2a58-4dcc-99bc-25370b8f7016 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Flavor pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:07:35.804239 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-786b791b-2a58-4dcc-99bc-25370b8f7016 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Image pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:07:35.804826 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-786b791b-2a58-4dcc-99bc-25370b8f7016 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:07:35.826555 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-786b791b-2a58-4dcc-99bc-25370b8f7016 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:35.827260 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-786b791b-2a58-4dcc-99bc-25370b8f7016 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:35.828235 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-786b791b-2a58-4dcc-99bc-25370b8f7016 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:35.828869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-786b791b-2a58-4dcc-99bc-25370b8f7016 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:35.850808 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-786b791b-2a58-4dcc-99bc-25370b8f7016 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Getting quotas for project 3716e192b1194365acb5595c8f92a862. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:07:35.856745 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-786b791b-2a58-4dcc-99bc-25370b8f7016 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Getting quotas for user 0e6fbab71db54b698572bb8a7d033063 and project 3716e192b1194365acb5595c8f92a862. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:07:35.948348 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-786b791b-2a58-4dcc-99bc-25370b8f7016 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Going to run 1 instances... {{(pid=124589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:07:35.951224 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-786b791b-2a58-4dcc-99bc-25370b8f7016 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6e0e2fbf-1930-4374-bce1-af59502b44d0',volume_size=None,volume_type=None)] {{(pid=124589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:07:36.130367 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-786b791b-2a58-4dcc-99bc-25370b8f7016 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.038677 Jun 16 15:07:36.134120 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 589/1167] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 15:07:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 15:07:36.144804 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0f107a89-c5e0-4c94-a5cc-67a0b63af4c6 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:36.152768 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0f107a89-c5e0-4c94-a5cc-67a0b63af4c6 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:36.225592 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0f107a89-c5e0-4c94-a5cc-67a0b63af4c6 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:36.233705 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0f107a89-c5e0-4c94-a5cc-67a0b63af4c6 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1089 microversion: 2.1 time: 0.093117 Jun 16 15:07:36.235113 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 579/1168] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:36 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1089 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:36.493898 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7e5be931-4d73-4065-b860-930d30f6a882 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:36.494515 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7e5be931-4d73-4065-b860-930d30f6a882 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:36.508394 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7e5be931-4d73-4065-b860-930d30f6a882 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:36.509104 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7e5be931-4d73-4065-b860-930d30f6a882 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:36.510049 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7e5be931-4d73-4065-b860-930d30f6a882 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:36.510643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7e5be931-4d73-4065-b860-930d30f6a882 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:36.694393 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7e5be931-4d73-4065-b860-930d30f6a882 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:36.703552 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7e5be931-4d73-4065-b860-930d30f6a882 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:36.705093 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7e5be931-4d73-4065-b860-930d30f6a882 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:36.706745 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7e5be931-4d73-4065-b860-930d30f6a882 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1737 microversion: 2.20 time: 0.217725 Jun 16 15:07:36.718442 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 590/1169] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:36 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1737 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:37.109310 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-0305d799-a50e-4974-93ff-b4d84e753b14 req-4c4fccfe-5143-44b8-ad87-5a136d71c6c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fdfccb3-ca19-46af-91ee-db50006827ac", "tag": "c40f32fc-ed69-4d0e-ae9b-74cae93701f8"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:37.118731 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-0305d799-a50e-4974-93ff-b4d84e753b14 req-4c4fccfe-5143-44b8-ad87-5a136d71c6c3 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:37.119242 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-0305d799-a50e-4974-93ff-b4d84e753b14 req-4c4fccfe-5143-44b8-ad87-5a136d71c6c3 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:37.131875 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-0305d799-a50e-4974-93ff-b4d84e753b14 req-4c4fccfe-5143-44b8-ad87-5a136d71c6c3 service nova] Creating event network-changed:c40f32fc-ed69-4d0e-ae9b-74cae93701f8 for instance 0fdfccb3-ca19-46af-91ee-db50006827ac on hv-cinder-83716 Jun 16 15:07:37.138367 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-0305d799-a50e-4974-93ff-b4d84e753b14 req-4c4fccfe-5143-44b8-ad87-5a136d71c6c3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034318 Jun 16 15:07:37.143078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 580/1170] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:37.251361 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c5398da3-2338-4432-a5b1-78a4578c4697 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:37.251969 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c5398da3-2338-4432-a5b1-78a4578c4697 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:37.259362 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c5398da3-2338-4432-a5b1-78a4578c4697 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:37.260061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c5398da3-2338-4432-a5b1-78a4578c4697 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:37.261070 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c5398da3-2338-4432-a5b1-78a4578c4697 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:37.262267 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c5398da3-2338-4432-a5b1-78a4578c4697 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:37.351370 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c5398da3-2338-4432-a5b1-78a4578c4697 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:37.360138 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c5398da3-2338-4432-a5b1-78a4578c4697 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1187 microversion: 2.1 time: 0.112629 Jun 16 15:07:37.361592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 591/1171] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:37 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1187 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:37.726836 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4d58b26b-e4fb-42c5-9ef7-ff0d02c85cae tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:37.728368 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4d58b26b-e4fb-42c5-9ef7-ff0d02c85cae tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:37.742594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d58b26b-e4fb-42c5-9ef7-ff0d02c85cae tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:37.743322 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d58b26b-e4fb-42c5-9ef7-ff0d02c85cae tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:37.744563 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d58b26b-e4fb-42c5-9ef7-ff0d02c85cae tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:37.748175 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d58b26b-e4fb-42c5-9ef7-ff0d02c85cae tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:38.184568 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4d58b26b-e4fb-42c5-9ef7-ff0d02c85cae tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:38.212266 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4d58b26b-e4fb-42c5-9ef7-ff0d02c85cae tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:38.215533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4d58b26b-e4fb-42c5-9ef7-ff0d02c85cae tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:38.217313 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4d58b26b-e4fb-42c5-9ef7-ff0d02c85cae tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1737 microversion: 2.20 time: 0.495139 Jun 16 15:07:38.229365 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 581/1172] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:37 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1737 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:38.379138 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-eb67d6a4-2969-4057-bdcb-826f5b13e752 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:38.380663 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-eb67d6a4-2969-4057-bdcb-826f5b13e752 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:38.388342 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eb67d6a4-2969-4057-bdcb-826f5b13e752 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:38.388897 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eb67d6a4-2969-4057-bdcb-826f5b13e752 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:38.389969 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eb67d6a4-2969-4057-bdcb-826f5b13e752 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:38.390648 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eb67d6a4-2969-4057-bdcb-826f5b13e752 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:38.482070 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-eb67d6a4-2969-4057-bdcb-826f5b13e752 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:38.499735 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-eb67d6a4-2969-4057-bdcb-826f5b13e752 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1205 microversion: 2.1 time: 0.124709 Jun 16 15:07:38.501266 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 592/1173] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:38 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1205 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:39.238543 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-06d9fc23-cd90-4cc9-8107-820a8f90ef38 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:39.239570 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-06d9fc23-cd90-4cc9-8107-820a8f90ef38 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:39.249702 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06d9fc23-cd90-4cc9-8107-820a8f90ef38 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:39.253246 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06d9fc23-cd90-4cc9-8107-820a8f90ef38 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:39.254413 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06d9fc23-cd90-4cc9-8107-820a8f90ef38 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:39.255037 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06d9fc23-cd90-4cc9-8107-820a8f90ef38 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:39.518492 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-aee1ec86-a5b9-4886-a9a2-8798733bde67 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:39.519701 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-aee1ec86-a5b9-4886-a9a2-8798733bde67 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:39.527469 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aee1ec86-a5b9-4886-a9a2-8798733bde67 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:39.528210 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aee1ec86-a5b9-4886-a9a2-8798733bde67 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:39.529284 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aee1ec86-a5b9-4886-a9a2-8798733bde67 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:39.529880 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aee1ec86-a5b9-4886-a9a2-8798733bde67 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:39.544375 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-06d9fc23-cd90-4cc9-8107-820a8f90ef38 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:39.553857 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-06d9fc23-cd90-4cc9-8107-820a8f90ef38 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:39.555365 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-06d9fc23-cd90-4cc9-8107-820a8f90ef38 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:39.562440 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-06d9fc23-cd90-4cc9-8107-820a8f90ef38 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1737 microversion: 2.20 time: 0.329170 Jun 16 15:07:39.579447 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 582/1174] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:39 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1737 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:39.760693 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-aee1ec86-a5b9-4886-a9a2-8798733bde67 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:39.771164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-aee1ec86-a5b9-4886-a9a2-8798733bde67 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.257307 Jun 16 15:07:39.773529 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 593/1175] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:39 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:07:40.033948 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-543dd570-860c-4f36-802e-3c93c529f0f3 req-151f8daa-d955-4745-b37e-fcc9888bace5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "781db76b-7a5f-47b1-8272-b4868d68c437", "tag": "328671dd-12a3-45cf-9250-1f0f36195bba"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:40.047457 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-543dd570-860c-4f36-802e-3c93c529f0f3 req-151f8daa-d955-4745-b37e-fcc9888bace5 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:40.048368 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-543dd570-860c-4f36-802e-3c93c529f0f3 req-151f8daa-d955-4745-b37e-fcc9888bace5 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:40.072227 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-543dd570-860c-4f36-802e-3c93c529f0f3 req-151f8daa-d955-4745-b37e-fcc9888bace5 service nova] Creating event network-changed:328671dd-12a3-45cf-9250-1f0f36195bba for instance 781db76b-7a5f-47b1-8272-b4868d68c437 on hv-cinder-83716 Jun 16 15:07:40.085952 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-543dd570-860c-4f36-802e-3c93c529f0f3 req-151f8daa-d955-4745-b37e-fcc9888bace5 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055902 Jun 16 15:07:40.088979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 583/1176] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:07:40.584201 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-140e8538-5cc1-47c3-a598-01a7a3dfd862 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:40.586114 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-140e8538-5cc1-47c3-a598-01a7a3dfd862 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:40.592858 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-140e8538-5cc1-47c3-a598-01a7a3dfd862 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:40.593315 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-140e8538-5cc1-47c3-a598-01a7a3dfd862 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:40.594269 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-140e8538-5cc1-47c3-a598-01a7a3dfd862 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:40.594898 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-140e8538-5cc1-47c3-a598-01a7a3dfd862 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:40.745441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-140e8538-5cc1-47c3-a598-01a7a3dfd862 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:40.754745 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-140e8538-5cc1-47c3-a598-01a7a3dfd862 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:40.756658 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-140e8538-5cc1-47c3-a598-01a7a3dfd862 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:40.758137 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-140e8538-5cc1-47c3-a598-01a7a3dfd862 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1737 microversion: 2.20 time: 0.179718 Jun 16 15:07:40.758913 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 594/1177] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:40 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1737 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:40.794643 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8d7bc0cb-7b7c-44ce-a888-12d3272d3d2e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:40.795474 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8d7bc0cb-7b7c-44ce-a888-12d3272d3d2e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:40.802924 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8d7bc0cb-7b7c-44ce-a888-12d3272d3d2e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:40.803389 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8d7bc0cb-7b7c-44ce-a888-12d3272d3d2e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:40.804163 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8d7bc0cb-7b7c-44ce-a888-12d3272d3d2e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:40.804611 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8d7bc0cb-7b7c-44ce-a888-12d3272d3d2e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:40.980753 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8d7bc0cb-7b7c-44ce-a888-12d3272d3d2e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:40.989027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8d7bc0cb-7b7c-44ce-a888-12d3272d3d2e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.201097 Jun 16 15:07:40.998405 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 584/1178] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:40 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:41.777181 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-25a0ec8f-b2f8-4c14-ba2a-e6acc6a0a6ce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:41.778373 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-25a0ec8f-b2f8-4c14-ba2a-e6acc6a0a6ce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:41.784699 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-25a0ec8f-b2f8-4c14-ba2a-e6acc6a0a6ce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:41.785204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-25a0ec8f-b2f8-4c14-ba2a-e6acc6a0a6ce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:41.785943 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-25a0ec8f-b2f8-4c14-ba2a-e6acc6a0a6ce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:41.786378 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-25a0ec8f-b2f8-4c14-ba2a-e6acc6a0a6ce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:41.951778 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-25a0ec8f-b2f8-4c14-ba2a-e6acc6a0a6ce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:41.961843 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-25a0ec8f-b2f8-4c14-ba2a-e6acc6a0a6ce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:41.963926 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-25a0ec8f-b2f8-4c14-ba2a-e6acc6a0a6ce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:41.965171 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-25a0ec8f-b2f8-4c14-ba2a-e6acc6a0a6ce tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1737 microversion: 2.20 time: 0.192303 Jun 16 15:07:41.965909 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 595/1179] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:41 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:42.005880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-04416b65-7cc3-47e3-b9c5-a847dfe88a79 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:42.007698 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-04416b65-7cc3-47e3-b9c5-a847dfe88a79 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:42.016815 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-04416b65-7cc3-47e3-b9c5-a847dfe88a79 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:42.017473 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-04416b65-7cc3-47e3-b9c5-a847dfe88a79 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:42.018356 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-04416b65-7cc3-47e3-b9c5-a847dfe88a79 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:42.018895 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-04416b65-7cc3-47e3-b9c5-a847dfe88a79 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:42.273065 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-04416b65-7cc3-47e3-b9c5-a847dfe88a79 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:42.285532 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-04416b65-7cc3-47e3-b9c5-a847dfe88a79 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.283341 Jun 16 15:07:42.286266 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 585/1180] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:42 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:42.983348 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-26172868-c25b-4e5c-998a-c31004168472 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:42.983960 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-26172868-c25b-4e5c-998a-c31004168472 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:42.990583 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-26172868-c25b-4e5c-998a-c31004168472 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:42.991036 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-26172868-c25b-4e5c-998a-c31004168472 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:42.991805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-26172868-c25b-4e5c-998a-c31004168472 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:42.992242 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-26172868-c25b-4e5c-998a-c31004168472 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:43.122378 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-26172868-c25b-4e5c-998a-c31004168472 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:43.130266 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-26172868-c25b-4e5c-998a-c31004168472 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:43.131763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-26172868-c25b-4e5c-998a-c31004168472 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:43.132942 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-26172868-c25b-4e5c-998a-c31004168472 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1737 microversion: 2.20 time: 0.153477 Jun 16 15:07:43.133548 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 596/1181] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:42 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:43.302073 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-19c57c6f-4a56-4a15-a6b8-c3257a3c72ce tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:43.302722 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-19c57c6f-4a56-4a15-a6b8-c3257a3c72ce tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:43.309797 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-19c57c6f-4a56-4a15-a6b8-c3257a3c72ce tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:43.310277 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-19c57c6f-4a56-4a15-a6b8-c3257a3c72ce tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:43.311046 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-19c57c6f-4a56-4a15-a6b8-c3257a3c72ce tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:43.311487 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-19c57c6f-4a56-4a15-a6b8-c3257a3c72ce tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:43.315624 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:43.448410 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-19c57c6f-4a56-4a15-a6b8-c3257a3c72ce tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:43.457178 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-19c57c6f-4a56-4a15-a6b8-c3257a3c72ce tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.158807 Jun 16 15:07:43.457742 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 586/1182] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:43 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:44.151353 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9eb30a21-0c49-4e01-ae15-bed7bdec88c3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:44.152552 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9eb30a21-0c49-4e01-ae15-bed7bdec88c3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:44.159224 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9eb30a21-0c49-4e01-ae15-bed7bdec88c3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:44.159680 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9eb30a21-0c49-4e01-ae15-bed7bdec88c3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:44.160445 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9eb30a21-0c49-4e01-ae15-bed7bdec88c3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:44.160911 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9eb30a21-0c49-4e01-ae15-bed7bdec88c3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:44.288516 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9eb30a21-0c49-4e01-ae15-bed7bdec88c3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:44.296399 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9eb30a21-0c49-4e01-ae15-bed7bdec88c3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:44.297908 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9eb30a21-0c49-4e01-ae15-bed7bdec88c3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:44.299063 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9eb30a21-0c49-4e01-ae15-bed7bdec88c3 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1719 microversion: 2.20 time: 0.151661 Jun 16 15:07:44.299615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 597/1183] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:44 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:44.474625 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-60fc7e45-28de-4ea3-a4e2-43f4796e95bc tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:44.475237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-60fc7e45-28de-4ea3-a4e2-43f4796e95bc tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:44.481727 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-60fc7e45-28de-4ea3-a4e2-43f4796e95bc tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:44.482184 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-60fc7e45-28de-4ea3-a4e2-43f4796e95bc tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:44.482938 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-60fc7e45-28de-4ea3-a4e2-43f4796e95bc tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:44.483374 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-60fc7e45-28de-4ea3-a4e2-43f4796e95bc tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:44.614712 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-60fc7e45-28de-4ea3-a4e2-43f4796e95bc tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:44.622628 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-60fc7e45-28de-4ea3-a4e2-43f4796e95bc tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.151974 Jun 16 15:07:44.623193 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 587/1184] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:44 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:45.317342 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a3969e29-6749-407a-b4d3-3d16b546d0eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:45.317985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a3969e29-6749-407a-b4d3-3d16b546d0eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:45.320276 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:45.325694 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a3969e29-6749-407a-b4d3-3d16b546d0eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:45.326152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a3969e29-6749-407a-b4d3-3d16b546d0eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:45.326948 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a3969e29-6749-407a-b4d3-3d16b546d0eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:45.327386 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a3969e29-6749-407a-b4d3-3d16b546d0eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:45.455709 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a3969e29-6749-407a-b4d3-3d16b546d0eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:45.463642 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a3969e29-6749-407a-b4d3-3d16b546d0eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:45.465176 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a3969e29-6749-407a-b4d3-3d16b546d0eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:45.466346 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a3969e29-6749-407a-b4d3-3d16b546d0eb tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1719 microversion: 2.20 time: 0.152972 Jun 16 15:07:45.466888 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 598/1185] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:45 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1719 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:45.639324 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-53355277-88b1-4eb8-bf72-2652e54aa002 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:45.640005 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-53355277-88b1-4eb8-bf72-2652e54aa002 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:45.646620 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-53355277-88b1-4eb8-bf72-2652e54aa002 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:45.647077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-53355277-88b1-4eb8-bf72-2652e54aa002 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:45.647845 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-53355277-88b1-4eb8-bf72-2652e54aa002 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:45.648290 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-53355277-88b1-4eb8-bf72-2652e54aa002 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:45.777784 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-53355277-88b1-4eb8-bf72-2652e54aa002 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:45.785747 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-53355277-88b1-4eb8-bf72-2652e54aa002 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.150288 Jun 16 15:07:45.786317 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 588/1186] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:45 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:46.299957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-0a99d9f1-f32a-4db2-a920-91a11378fd74 req-b24ac077-10df-467c-bbba-82ba1ba0aece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53e3fc3-e13f-4352-ad2f-7babd83b19e3", "name": "network-vif-unplugged", "status": "completed", "tag": "2fd6981b-720b-4e5e-a50b-00f468402a5f"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:46.304953 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:46.305603 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=6 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:46.311385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-0a99d9f1-f32a-4db2-a920-91a11378fd74 req-b24ac077-10df-467c-bbba-82ba1ba0aece service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:46.312638 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-0a99d9f1-f32a-4db2-a920-91a11378fd74 req-b24ac077-10df-467c-bbba-82ba1ba0aece service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:46.326973 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-0a99d9f1-f32a-4db2-a920-91a11378fd74 req-b24ac077-10df-467c-bbba-82ba1ba0aece service nova] Creating event network-vif-unplugged:2fd6981b-720b-4e5e-a50b-00f468402a5f for instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 on hv-cinder-83716 Jun 16 15:07:46.332771 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-0a99d9f1-f32a-4db2-a920-91a11378fd74 req-b24ac077-10df-467c-bbba-82ba1ba0aece service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036348 Jun 16 15:07:46.333640 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 599/1187] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:07:46.483642 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d522b057-3fb5-4108-b95a-f01a2ea3c049 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:46.484193 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d522b057-3fb5-4108-b95a-f01a2ea3c049 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:46.486087 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:46.491825 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d522b057-3fb5-4108-b95a-f01a2ea3c049 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:46.492279 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d522b057-3fb5-4108-b95a-f01a2ea3c049 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:46.493080 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d522b057-3fb5-4108-b95a-f01a2ea3c049 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:46.493519 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d522b057-3fb5-4108-b95a-f01a2ea3c049 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:46.622620 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d522b057-3fb5-4108-b95a-f01a2ea3c049 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:46.630777 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d522b057-3fb5-4108-b95a-f01a2ea3c049 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:46.632302 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d522b057-3fb5-4108-b95a-f01a2ea3c049 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:46.633481 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d522b057-3fb5-4108-b95a-f01a2ea3c049 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1662 microversion: 2.20 time: 0.153939 Jun 16 15:07:46.634037 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 589/1188] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:46 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:46.652580 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d29e889e-903c-4be2-a6e3-fc5fc42f33d7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "678d1a31-d5da-4a1a-bbad-f5ea1064ec17"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:46.653755 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d29e889e-903c-4be2-a6e3-fc5fc42f33d7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:46.660182 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d29e889e-903c-4be2-a6e3-fc5fc42f33d7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:46.660630 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d29e889e-903c-4be2-a6e3-fc5fc42f33d7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:46.661414 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d29e889e-903c-4be2-a6e3-fc5fc42f33d7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:46.661848 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d29e889e-903c-4be2-a6e3-fc5fc42f33d7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:46.803417 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-58b47cc8-e3dc-43d4-a51b-f54f5fd911be tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:46.804243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-58b47cc8-e3dc-43d4-a51b-f54f5fd911be tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:46.811565 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-58b47cc8-e3dc-43d4-a51b-f54f5fd911be tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:46.812028 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-58b47cc8-e3dc-43d4-a51b-f54f5fd911be tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:46.812784 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-58b47cc8-e3dc-43d4-a51b-f54f5fd911be tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:46.813237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-58b47cc8-e3dc-43d4-a51b-f54f5fd911be tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:46.947411 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d29e889e-903c-4be2-a6e3-fc5fc42f33d7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "POST /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299770 Jun 16 15:07:46.948185 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 600/1189] 10.222.0.72 () {62 vars in 1363 bytes} [Thu Jun 16 15:07:46 2022] POST /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 15:07:46.980031 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-58b47cc8-e3dc-43d4-a51b-f54f5fd911be tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:46.989264 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-58b47cc8-e3dc-43d4-a51b-f54f5fd911be tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.189637 Jun 16 15:07:46.989857 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 590/1190] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:46 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:07:47.070367 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-bf9a1834-7db8-413f-a950-a26f8d38bba5 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:47.070866 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-bf9a1834-7db8-413f-a950-a26f8d38bba5 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:47.077581 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bf9a1834-7db8-413f-a950-a26f8d38bba5 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:47.078036 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bf9a1834-7db8-413f-a950-a26f8d38bba5 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:47.078803 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bf9a1834-7db8-413f-a950-a26f8d38bba5 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:47.079242 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bf9a1834-7db8-413f-a950-a26f8d38bba5 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:47.168115 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:47.339225 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-bf9a1834-7db8-413f-a950-a26f8d38bba5 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3/os-volume_attachments/678d1a31-d5da-4a1a-bbad-f5ea1064ec17" status: 202 len: 0 microversion: 2.20 time: 0.272691 Jun 16 15:07:47.340245 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 601/1191] 10.222.0.72 () {60 vars in 1456 bytes} [Thu Jun 16 15:07:47 2022] DELETE /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3/os-volume_attachments/678d1a31-d5da-4a1a-bbad-f5ea1064ec17 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:07:47.395097 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2e519156-f5e2-455d-8a1a-8d3ae3410719 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:47.395700 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2e519156-f5e2-455d-8a1a-8d3ae3410719 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:47.401847 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e519156-f5e2-455d-8a1a-8d3ae3410719 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:47.402297 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e519156-f5e2-455d-8a1a-8d3ae3410719 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:47.403058 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e519156-f5e2-455d-8a1a-8d3ae3410719 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:47.403494 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e519156-f5e2-455d-8a1a-8d3ae3410719 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:47.476610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2e519156-f5e2-455d-8a1a-8d3ae3410719 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "POST /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3/action" status: 202 len: 0 microversion: 2.20 time: 0.085391 Jun 16 15:07:47.477261 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 591/1192] 10.222.0.72 () {62 vars in 1318 bytes} [Thu Jun 16 15:07:47 2022] POST /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:07:47.486162 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-cc4bdbce-b87a-47ea-a0c8-e57a5c198ed9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:47.486865 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-cc4bdbce-b87a-47ea-a0c8-e57a5c198ed9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:47.493118 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cc4bdbce-b87a-47ea-a0c8-e57a5c198ed9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:47.493670 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cc4bdbce-b87a-47ea-a0c8-e57a5c198ed9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:47.494442 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cc4bdbce-b87a-47ea-a0c8-e57a5c198ed9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:47.494930 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cc4bdbce-b87a-47ea-a0c8-e57a5c198ed9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:47.629029 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-cc4bdbce-b87a-47ea-a0c8-e57a5c198ed9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:47.637019 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-cc4bdbce-b87a-47ea-a0c8-e57a5c198ed9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:47.638509 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-cc4bdbce-b87a-47ea-a0c8-e57a5c198ed9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:47.639736 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-cc4bdbce-b87a-47ea-a0c8-e57a5c198ed9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1670 microversion: 2.20 time: 0.157540 Jun 16 15:07:47.640285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 602/1193] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:47 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:48.006378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6cf66414-f27f-4255-bdb1-63332cee8a3c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:48.007135 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6cf66414-f27f-4255-bdb1-63332cee8a3c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:48.013865 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6cf66414-f27f-4255-bdb1-63332cee8a3c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:48.014395 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6cf66414-f27f-4255-bdb1-63332cee8a3c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:48.015240 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6cf66414-f27f-4255-bdb1-63332cee8a3c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:48.015689 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6cf66414-f27f-4255-bdb1-63332cee8a3c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:48.153701 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6cf66414-f27f-4255-bdb1-63332cee8a3c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:48.161453 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6cf66414-f27f-4255-bdb1-63332cee8a3c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.159402 Jun 16 15:07:48.162005 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 592/1194] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:48 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:48.658112 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ecba3c83-dca7-45f5-baaa-c5357e21282e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:48.658651 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ecba3c83-dca7-45f5-baaa-c5357e21282e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:48.665130 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ecba3c83-dca7-45f5-baaa-c5357e21282e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:48.665580 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ecba3c83-dca7-45f5-baaa-c5357e21282e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:48.666326 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ecba3c83-dca7-45f5-baaa-c5357e21282e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:48.666753 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ecba3c83-dca7-45f5-baaa-c5357e21282e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:48.797051 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ecba3c83-dca7-45f5-baaa-c5357e21282e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:48.805399 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ecba3c83-dca7-45f5-baaa-c5357e21282e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:48.806897 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ecba3c83-dca7-45f5-baaa-c5357e21282e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:48.808660 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ecba3c83-dca7-45f5-baaa-c5357e21282e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.154195 Jun 16 15:07:48.809433 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 603/1195] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:48 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:49.178195 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c2e37b4f-f7aa-49b1-83c3-6286a448f968 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:49.178828 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c2e37b4f-f7aa-49b1-83c3-6286a448f968 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:49.185983 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c2e37b4f-f7aa-49b1-83c3-6286a448f968 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:49.186465 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c2e37b4f-f7aa-49b1-83c3-6286a448f968 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:49.187232 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c2e37b4f-f7aa-49b1-83c3-6286a448f968 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:49.187674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c2e37b4f-f7aa-49b1-83c3-6286a448f968 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:49.399789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c2e37b4f-f7aa-49b1-83c3-6286a448f968 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:49.407637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c2e37b4f-f7aa-49b1-83c3-6286a448f968 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.233050 Jun 16 15:07:49.408205 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 593/1196] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:49 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:49.827468 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9ebf29c8-b586-4d83-92c9-1f45b2d42e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:49.828112 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9ebf29c8-b586-4d83-92c9-1f45b2d42e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:49.834381 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ebf29c8-b586-4d83-92c9-1f45b2d42e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:49.834928 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ebf29c8-b586-4d83-92c9-1f45b2d42e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:49.835594 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ebf29c8-b586-4d83-92c9-1f45b2d42e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:49.836121 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ebf29c8-b586-4d83-92c9-1f45b2d42e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:49.983253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9ebf29c8-b586-4d83-92c9-1f45b2d42e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:49.995150 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9ebf29c8-b586-4d83-92c9-1f45b2d42e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:49.997885 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9ebf29c8-b586-4d83-92c9-1f45b2d42e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:49.999600 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9ebf29c8-b586-4d83-92c9-1f45b2d42e0e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.176554 Jun 16 15:07:50.010652 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 604/1197] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:49 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:50.424401 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f42f1eb8-4ca9-4044-b7fa-c91b7c20470a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:50.425126 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f42f1eb8-4ca9-4044-b7fa-c91b7c20470a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:50.428640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=80 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:50.432790 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f42f1eb8-4ca9-4044-b7fa-c91b7c20470a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:50.434150 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f42f1eb8-4ca9-4044-b7fa-c91b7c20470a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:50.435214 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f42f1eb8-4ca9-4044-b7fa-c91b7c20470a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:50.435880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f42f1eb8-4ca9-4044-b7fa-c91b7c20470a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:50.592979 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f42f1eb8-4ca9-4044-b7fa-c91b7c20470a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:50.600641 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f42f1eb8-4ca9-4044-b7fa-c91b7c20470a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.180177 Jun 16 15:07:50.601321 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 594/1198] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:50 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:51.018141 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-71b8a02c-efa8-4290-8dd5-06f34f78f462 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:51.018748 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-71b8a02c-efa8-4290-8dd5-06f34f78f462 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:51.026082 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-71b8a02c-efa8-4290-8dd5-06f34f78f462 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:51.026541 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-71b8a02c-efa8-4290-8dd5-06f34f78f462 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:51.028004 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-71b8a02c-efa8-4290-8dd5-06f34f78f462 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:51.028375 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-71b8a02c-efa8-4290-8dd5-06f34f78f462 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:51.183467 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-71b8a02c-efa8-4290-8dd5-06f34f78f462 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:51.193987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-71b8a02c-efa8-4290-8dd5-06f34f78f462 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:51.195797 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-71b8a02c-efa8-4290-8dd5-06f34f78f462 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:51.197028 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-71b8a02c-efa8-4290-8dd5-06f34f78f462 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.182762 Jun 16 15:07:51.198110 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 605/1199] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:51 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:51.618014 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-807f9b42-7a51-4972-9f62-c5fca657402d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:51.618647 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-807f9b42-7a51-4972-9f62-c5fca657402d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:51.626393 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-807f9b42-7a51-4972-9f62-c5fca657402d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:51.626850 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-807f9b42-7a51-4972-9f62-c5fca657402d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:51.627627 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-807f9b42-7a51-4972-9f62-c5fca657402d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:51.628074 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-807f9b42-7a51-4972-9f62-c5fca657402d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:51.763205 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-807f9b42-7a51-4972-9f62-c5fca657402d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:51.771029 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-807f9b42-7a51-4972-9f62-c5fca657402d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.156930 Jun 16 15:07:51.771606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 595/1200] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:51 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:52.216650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a00156c2-7cb2-460b-8799-234e652634ca tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:52.217311 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a00156c2-7cb2-460b-8799-234e652634ca tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:52.224394 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a00156c2-7cb2-460b-8799-234e652634ca tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:52.224868 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a00156c2-7cb2-460b-8799-234e652634ca tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:52.225651 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a00156c2-7cb2-460b-8799-234e652634ca tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:52.226081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a00156c2-7cb2-460b-8799-234e652634ca tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:52.365533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a00156c2-7cb2-460b-8799-234e652634ca tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:52.373585 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a00156c2-7cb2-460b-8799-234e652634ca tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:52.375087 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a00156c2-7cb2-460b-8799-234e652634ca tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:52.376262 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a00156c2-7cb2-460b-8799-234e652634ca tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.164481 Jun 16 15:07:52.377026 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 606/1201] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:52 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 15:07:52.587690 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-58e1a9ef-faf8-4e81-b2b0-f71f999c120e req-7604b32a-6585-48e3-b2a7-6c82b0f1aa13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781db76b-7a5f-47b1-8272-b4868d68c437", "name": "network-vif-plugged", "status": "completed", "tag": "328671dd-12a3-45cf-9250-1f0f36195bba"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:07:52.596494 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-58e1a9ef-faf8-4e81-b2b0-f71f999c120e req-7604b32a-6585-48e3-b2a7-6c82b0f1aa13 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:52.596997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-58e1a9ef-faf8-4e81-b2b0-f71f999c120e req-7604b32a-6585-48e3-b2a7-6c82b0f1aa13 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:52.609515 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-58e1a9ef-faf8-4e81-b2b0-f71f999c120e req-7604b32a-6585-48e3-b2a7-6c82b0f1aa13 service nova] Creating event network-vif-plugged:328671dd-12a3-45cf-9250-1f0f36195bba for instance 781db76b-7a5f-47b1-8272-b4868d68c437 on hv-cinder-83716 Jun 16 15:07:52.614929 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-58e1a9ef-faf8-4e81-b2b0-f71f999c120e req-7604b32a-6585-48e3-b2a7-6c82b0f1aa13 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030912 Jun 16 15:07:52.615535 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 596/1202] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:07:52.787714 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c6ebeef1-7eeb-4f7e-a47c-7c8d8d72fd2b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:52.788323 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c6ebeef1-7eeb-4f7e-a47c-7c8d8d72fd2b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:52.794413 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c6ebeef1-7eeb-4f7e-a47c-7c8d8d72fd2b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:52.794858 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c6ebeef1-7eeb-4f7e-a47c-7c8d8d72fd2b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:52.795615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c6ebeef1-7eeb-4f7e-a47c-7c8d8d72fd2b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:52.796043 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c6ebeef1-7eeb-4f7e-a47c-7c8d8d72fd2b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:52.931444 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c6ebeef1-7eeb-4f7e-a47c-7c8d8d72fd2b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:52.939674 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c6ebeef1-7eeb-4f7e-a47c-7c8d8d72fd2b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.155731 Jun 16 15:07:52.940239 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 607/1203] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:52 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:53.395710 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-07d54d7e-c216-44d6-b45c-1f5ed206613a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:53.396416 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-07d54d7e-c216-44d6-b45c-1f5ed206613a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:53.403016 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-07d54d7e-c216-44d6-b45c-1f5ed206613a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:53.403615 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-07d54d7e-c216-44d6-b45c-1f5ed206613a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:53.404465 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-07d54d7e-c216-44d6-b45c-1f5ed206613a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:53.404948 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-07d54d7e-c216-44d6-b45c-1f5ed206613a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:53.544832 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-07d54d7e-c216-44d6-b45c-1f5ed206613a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:53.553463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-07d54d7e-c216-44d6-b45c-1f5ed206613a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:53.555081 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-07d54d7e-c216-44d6-b45c-1f5ed206613a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:53.556359 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-07d54d7e-c216-44d6-b45c-1f5ed206613a tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.165379 Jun 16 15:07:53.557021 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 597/1204] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:53 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:53.957196 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-77b581a0-95f5-4787-ba2b-d4a298c9000c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:53.957806 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-77b581a0-95f5-4787-ba2b-d4a298c9000c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:53.964781 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-77b581a0-95f5-4787-ba2b-d4a298c9000c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:53.965270 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-77b581a0-95f5-4787-ba2b-d4a298c9000c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:53.966037 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-77b581a0-95f5-4787-ba2b-d4a298c9000c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:53.966472 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-77b581a0-95f5-4787-ba2b-d4a298c9000c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:54.106659 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-77b581a0-95f5-4787-ba2b-d4a298c9000c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:54.114642 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-77b581a0-95f5-4787-ba2b-d4a298c9000c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.161306 Jun 16 15:07:54.115221 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 608/1205] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:53 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:54.575698 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2cdbbce1-8c62-4b06-8595-c675c0c76eaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:54.577143 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2cdbbce1-8c62-4b06-8595-c675c0c76eaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:54.583600 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2cdbbce1-8c62-4b06-8595-c675c0c76eaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:54.584064 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2cdbbce1-8c62-4b06-8595-c675c0c76eaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:54.584873 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2cdbbce1-8c62-4b06-8595-c675c0c76eaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:54.585309 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2cdbbce1-8c62-4b06-8595-c675c0c76eaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:54.720446 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2cdbbce1-8c62-4b06-8595-c675c0c76eaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:54.728607 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2cdbbce1-8c62-4b06-8595-c675c0c76eaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:54.730174 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2cdbbce1-8c62-4b06-8595-c675c0c76eaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:54.731346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2cdbbce1-8c62-4b06-8595-c675c0c76eaa tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.160171 Jun 16 15:07:54.731899 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 598/1206] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:54 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:55.131592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-56e5ed46-fc4f-4a3a-ae8f-e5c2851cf337 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:55.132352 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-56e5ed46-fc4f-4a3a-ae8f-e5c2851cf337 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:55.139842 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-56e5ed46-fc4f-4a3a-ae8f-e5c2851cf337 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:55.140231 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-56e5ed46-fc4f-4a3a-ae8f-e5c2851cf337 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:55.141030 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-56e5ed46-fc4f-4a3a-ae8f-e5c2851cf337 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:55.141473 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-56e5ed46-fc4f-4a3a-ae8f-e5c2851cf337 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:55.278695 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-56e5ed46-fc4f-4a3a-ae8f-e5c2851cf337 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:55.286683 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-56e5ed46-fc4f-4a3a-ae8f-e5c2851cf337 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.158911 Jun 16 15:07:55.287244 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 609/1207] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:55 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:55.749507 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bc7df2bc-5d2d-4cc5-b424-575be131dbf0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:55.750169 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bc7df2bc-5d2d-4cc5-b424-575be131dbf0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:55.757126 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc7df2bc-5d2d-4cc5-b424-575be131dbf0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:55.757594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc7df2bc-5d2d-4cc5-b424-575be131dbf0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:55.758372 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc7df2bc-5d2d-4cc5-b424-575be131dbf0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:55.758815 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc7df2bc-5d2d-4cc5-b424-575be131dbf0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:55.892883 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bc7df2bc-5d2d-4cc5-b424-575be131dbf0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:55.901025 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bc7df2bc-5d2d-4cc5-b424-575be131dbf0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:55.903048 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bc7df2bc-5d2d-4cc5-b424-575be131dbf0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:55.904233 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bc7df2bc-5d2d-4cc5-b424-575be131dbf0 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.158642 Jun 16 15:07:55.905008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 599/1208] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:55 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:56.303593 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7ff185c2-e783-43ba-8856-0b84a927fda2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:56.305130 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7ff185c2-e783-43ba-8856-0b84a927fda2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:56.312678 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ff185c2-e783-43ba-8856-0b84a927fda2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:56.313229 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ff185c2-e783-43ba-8856-0b84a927fda2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:56.314055 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ff185c2-e783-43ba-8856-0b84a927fda2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:56.314588 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ff185c2-e783-43ba-8856-0b84a927fda2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:56.457611 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7ff185c2-e783-43ba-8856-0b84a927fda2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:56.465917 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7ff185c2-e783-43ba-8856-0b84a927fda2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.166084 Jun 16 15:07:56.475123 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 610/1209] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:56 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:56.922638 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d7afa29f-2ea9-47d1-a840-8d7c353f5e31 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:56.923397 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d7afa29f-2ea9-47d1-a840-8d7c353f5e31 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:56.930922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7afa29f-2ea9-47d1-a840-8d7c353f5e31 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:56.931372 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7afa29f-2ea9-47d1-a840-8d7c353f5e31 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:56.932150 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7afa29f-2ea9-47d1-a840-8d7c353f5e31 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:56.932588 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7afa29f-2ea9-47d1-a840-8d7c353f5e31 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:57.076537 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d7afa29f-2ea9-47d1-a840-8d7c353f5e31 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:57.088092 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d7afa29f-2ea9-47d1-a840-8d7c353f5e31 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:57.090482 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d7afa29f-2ea9-47d1-a840-8d7c353f5e31 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:57.093313 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d7afa29f-2ea9-47d1-a840-8d7c353f5e31 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.174559 Jun 16 15:07:57.093894 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 600/1210] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:56 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:57.482646 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d098c2b7-075a-455a-804e-2caebf50b44c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:57.483258 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d098c2b7-075a-455a-804e-2caebf50b44c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:57.490146 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d098c2b7-075a-455a-804e-2caebf50b44c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:57.490600 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d098c2b7-075a-455a-804e-2caebf50b44c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:57.491385 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d098c2b7-075a-455a-804e-2caebf50b44c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:57.491826 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d098c2b7-075a-455a-804e-2caebf50b44c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:57.631975 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d098c2b7-075a-455a-804e-2caebf50b44c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:57.639440 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d098c2b7-075a-455a-804e-2caebf50b44c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.160670 Jun 16 15:07:57.640009 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 611/1211] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:57 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:58.111690 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-26ed8348-7b85-4c85-96bc-6fca88a9405d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:58.112396 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-26ed8348-7b85-4c85-96bc-6fca88a9405d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:58.119043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-26ed8348-7b85-4c85-96bc-6fca88a9405d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:58.119501 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-26ed8348-7b85-4c85-96bc-6fca88a9405d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:58.120277 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-26ed8348-7b85-4c85-96bc-6fca88a9405d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:58.120722 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-26ed8348-7b85-4c85-96bc-6fca88a9405d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:58.251469 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-26ed8348-7b85-4c85-96bc-6fca88a9405d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:58.261582 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-26ed8348-7b85-4c85-96bc-6fca88a9405d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:58.263121 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-26ed8348-7b85-4c85-96bc-6fca88a9405d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:58.264297 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-26ed8348-7b85-4c85-96bc-6fca88a9405d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.156591 Jun 16 15:07:58.264877 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 601/1212] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:58 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:58.656736 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7dc00f2d-b324-4d25-ba76-fc43ecb2994d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:58.657664 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7dc00f2d-b324-4d25-ba76-fc43ecb2994d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:58.664573 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7dc00f2d-b324-4d25-ba76-fc43ecb2994d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:58.665075 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7dc00f2d-b324-4d25-ba76-fc43ecb2994d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:58.665838 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7dc00f2d-b324-4d25-ba76-fc43ecb2994d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:58.666272 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7dc00f2d-b324-4d25-ba76-fc43ecb2994d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:58.798274 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7dc00f2d-b324-4d25-ba76-fc43ecb2994d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:58.805644 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7dc00f2d-b324-4d25-ba76-fc43ecb2994d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.152830 Jun 16 15:07:58.806201 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 612/1213] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:58 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:07:59.282309 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fc3492ad-f213-42a2-927d-a180b3da4e77 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:59.282938 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fc3492ad-f213-42a2-927d-a180b3da4e77 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:59.289847 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fc3492ad-f213-42a2-927d-a180b3da4e77 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:59.290308 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fc3492ad-f213-42a2-927d-a180b3da4e77 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:59.291088 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fc3492ad-f213-42a2-927d-a180b3da4e77 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:59.291535 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fc3492ad-f213-42a2-927d-a180b3da4e77 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:59.311736 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:07:59.438282 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-fc3492ad-f213-42a2-927d-a180b3da4e77 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:59.450155 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-fc3492ad-f213-42a2-927d-a180b3da4e77 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:59.451741 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-fc3492ad-f213-42a2-927d-a180b3da4e77 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:59.452958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fc3492ad-f213-42a2-927d-a180b3da4e77 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.174822 Jun 16 15:07:59.453697 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 602/1214] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:07:59 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:07:59.822741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-39b72720-e1c1-4acc-80d0-a58c8ff42a37 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:07:59.823953 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-39b72720-e1c1-4acc-80d0-a58c8ff42a37 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:07:59.830683 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39b72720-e1c1-4acc-80d0-a58c8ff42a37 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:59.831210 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39b72720-e1c1-4acc-80d0-a58c8ff42a37 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:59.832053 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39b72720-e1c1-4acc-80d0-a58c8ff42a37 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:07:59.832559 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39b72720-e1c1-4acc-80d0-a58c8ff42a37 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:07:59.975371 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-39b72720-e1c1-4acc-80d0-a58c8ff42a37 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:07:59.983434 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-39b72720-e1c1-4acc-80d0-a58c8ff42a37 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.164367 Jun 16 15:07:59.984034 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 613/1215] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:07:59 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:08:00.470839 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ee1caffd-ac3a-401b-9f10-2668e556f298 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:00.471457 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ee1caffd-ac3a-401b-9f10-2668e556f298 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:00.477948 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ee1caffd-ac3a-401b-9f10-2668e556f298 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:00.478410 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ee1caffd-ac3a-401b-9f10-2668e556f298 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:00.479178 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ee1caffd-ac3a-401b-9f10-2668e556f298 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:00.479623 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ee1caffd-ac3a-401b-9f10-2668e556f298 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:00.609704 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ee1caffd-ac3a-401b-9f10-2668e556f298 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:00.618449 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ee1caffd-ac3a-401b-9f10-2668e556f298 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:00.619986 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ee1caffd-ac3a-401b-9f10-2668e556f298 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:00.621866 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ee1caffd-ac3a-401b-9f10-2668e556f298 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.154926 Jun 16 15:08:00.622421 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 603/1216] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:00 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:01.000749 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-45f0672b-c47a-498b-8659-e63786fe3084 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:01.001388 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-45f0672b-c47a-498b-8659-e63786fe3084 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:01.007901 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-45f0672b-c47a-498b-8659-e63786fe3084 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:01.008350 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-45f0672b-c47a-498b-8659-e63786fe3084 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:01.009146 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-45f0672b-c47a-498b-8659-e63786fe3084 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:01.009581 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-45f0672b-c47a-498b-8659-e63786fe3084 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:01.153960 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-45f0672b-c47a-498b-8659-e63786fe3084 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:01.161821 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-45f0672b-c47a-498b-8659-e63786fe3084 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.164922 Jun 16 15:08:01.162384 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 614/1217] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:08:00 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:08:01.639474 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1b0763f6-0b35-4d1f-a2f6-7e492c1f413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:01.640181 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1b0763f6-0b35-4d1f-a2f6-7e492c1f413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:01.646652 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1b0763f6-0b35-4d1f-a2f6-7e492c1f413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:01.647108 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1b0763f6-0b35-4d1f-a2f6-7e492c1f413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:01.647866 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1b0763f6-0b35-4d1f-a2f6-7e492c1f413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:01.648310 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1b0763f6-0b35-4d1f-a2f6-7e492c1f413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:01.792678 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1b0763f6-0b35-4d1f-a2f6-7e492c1f413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:01.800789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1b0763f6-0b35-4d1f-a2f6-7e492c1f413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:01.802331 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1b0763f6-0b35-4d1f-a2f6-7e492c1f413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:01.803501 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1b0763f6-0b35-4d1f-a2f6-7e492c1f413e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.167914 Jun 16 15:08:01.804062 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 604/1218] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:01 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:02.177869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b1cb5034-2a02-4501-ac99-d2dfba733be0 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:02.178501 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b1cb5034-2a02-4501-ac99-d2dfba733be0 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:02.185648 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b1cb5034-2a02-4501-ac99-d2dfba733be0 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:02.186106 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b1cb5034-2a02-4501-ac99-d2dfba733be0 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:02.186868 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b1cb5034-2a02-4501-ac99-d2dfba733be0 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:02.187307 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b1cb5034-2a02-4501-ac99-d2dfba733be0 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:02.323113 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b1cb5034-2a02-4501-ac99-d2dfba733be0 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:02.330552 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b1cb5034-2a02-4501-ac99-d2dfba733be0 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.156567 Jun 16 15:08:02.331129 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 615/1219] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:08:02 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:08:02.821389 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b036dde6-76fb-44be-8222-93ac5fe8ceb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:02.821996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b036dde6-76fb-44be-8222-93ac5fe8ceb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:02.829004 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b036dde6-76fb-44be-8222-93ac5fe8ceb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:02.829461 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b036dde6-76fb-44be-8222-93ac5fe8ceb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:02.830224 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b036dde6-76fb-44be-8222-93ac5fe8ceb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:02.830668 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b036dde6-76fb-44be-8222-93ac5fe8ceb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:02.960530 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b036dde6-76fb-44be-8222-93ac5fe8ceb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:02.969168 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b036dde6-76fb-44be-8222-93ac5fe8ceb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:02.970662 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b036dde6-76fb-44be-8222-93ac5fe8ceb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:02.971820 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b036dde6-76fb-44be-8222-93ac5fe8ceb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.154335 Jun 16 15:08:02.972380 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 605/1220] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:02 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:03.347211 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6f785168-ff1a-4a9d-9f60-58ec852d2425 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:03.347823 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6f785168-ff1a-4a9d-9f60-58ec852d2425 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:03.354351 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f785168-ff1a-4a9d-9f60-58ec852d2425 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:03.355400 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f785168-ff1a-4a9d-9f60-58ec852d2425 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:03.356151 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f785168-ff1a-4a9d-9f60-58ec852d2425 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:03.356586 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f785168-ff1a-4a9d-9f60-58ec852d2425 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:03.371365 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:03.486257 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6f785168-ff1a-4a9d-9f60-58ec852d2425 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:03.493821 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6f785168-ff1a-4a9d-9f60-58ec852d2425 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.150558 Jun 16 15:08:03.494379 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 616/1221] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:08:03 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:08:03.989719 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b0cad3b1-2b4c-4acc-a24c-5b034519c915 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:03.990333 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b0cad3b1-2b4c-4acc-a24c-5b034519c915 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:03.997758 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b0cad3b1-2b4c-4acc-a24c-5b034519c915 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:03.998336 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b0cad3b1-2b4c-4acc-a24c-5b034519c915 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:03.999109 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b0cad3b1-2b4c-4acc-a24c-5b034519c915 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:03.999551 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b0cad3b1-2b4c-4acc-a24c-5b034519c915 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:04.137872 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b0cad3b1-2b4c-4acc-a24c-5b034519c915 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:04.146106 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b0cad3b1-2b4c-4acc-a24c-5b034519c915 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:04.147619 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b0cad3b1-2b4c-4acc-a24c-5b034519c915 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:04.148780 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b0cad3b1-2b4c-4acc-a24c-5b034519c915 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.162974 Jun 16 15:08:04.149378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 606/1222] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:03 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:04.510546 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6d119d9d-4804-4f07-bb8a-61f93c3f4d42 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:04.511606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6d119d9d-4804-4f07-bb8a-61f93c3f4d42 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:04.518092 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d119d9d-4804-4f07-bb8a-61f93c3f4d42 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:04.518550 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d119d9d-4804-4f07-bb8a-61f93c3f4d42 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:04.519311 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d119d9d-4804-4f07-bb8a-61f93c3f4d42 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:04.519747 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d119d9d-4804-4f07-bb8a-61f93c3f4d42 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:04.663363 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6d119d9d-4804-4f07-bb8a-61f93c3f4d42 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:04.670762 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6d119d9d-4804-4f07-bb8a-61f93c3f4d42 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.164238 Jun 16 15:08:04.671326 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 617/1223] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:08:04 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:08:05.167780 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7c4f66a8-d1f8-496a-811c-4f4b4a59132b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:05.168330 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7c4f66a8-d1f8-496a-811c-4f4b4a59132b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:05.174825 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7c4f66a8-d1f8-496a-811c-4f4b4a59132b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:05.175277 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7c4f66a8-d1f8-496a-811c-4f4b4a59132b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:05.176039 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7c4f66a8-d1f8-496a-811c-4f4b4a59132b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:05.176478 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7c4f66a8-d1f8-496a-811c-4f4b4a59132b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:05.306868 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7c4f66a8-d1f8-496a-811c-4f4b4a59132b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:05.315504 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7c4f66a8-d1f8-496a-811c-4f4b4a59132b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:05.317042 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7c4f66a8-d1f8-496a-811c-4f4b4a59132b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:05.318202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7c4f66a8-d1f8-496a-811c-4f4b4a59132b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.155000 Jun 16 15:08:05.318754 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 607/1224] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:05 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:05.687596 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-04aa0324-262e-4b4c-a6af-d13946501b0f tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:05.688236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-04aa0324-262e-4b4c-a6af-d13946501b0f tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:05.694778 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04aa0324-262e-4b4c-a6af-d13946501b0f tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:05.695260 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04aa0324-262e-4b4c-a6af-d13946501b0f tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:05.696020 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04aa0324-262e-4b4c-a6af-d13946501b0f tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:05.696458 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04aa0324-262e-4b4c-a6af-d13946501b0f tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:05.824247 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-04aa0324-262e-4b4c-a6af-d13946501b0f tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:05.831770 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-04aa0324-262e-4b4c-a6af-d13946501b0f tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.148124 Jun 16 15:08:05.832333 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 618/1225] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:08:05 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:08:06.335974 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0d7aacc2-f11b-4e69-b4d5-485cb1184ff9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:06.336616 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0d7aacc2-f11b-4e69-b4d5-485cb1184ff9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:06.343155 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0d7aacc2-f11b-4e69-b4d5-485cb1184ff9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:06.343608 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0d7aacc2-f11b-4e69-b4d5-485cb1184ff9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:06.344367 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0d7aacc2-f11b-4e69-b4d5-485cb1184ff9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:06.344830 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0d7aacc2-f11b-4e69-b4d5-485cb1184ff9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:06.472346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0d7aacc2-f11b-4e69-b4d5-485cb1184ff9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:06.480530 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0d7aacc2-f11b-4e69-b4d5-485cb1184ff9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:06.482055 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0d7aacc2-f11b-4e69-b4d5-485cb1184ff9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:06.483208 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0d7aacc2-f11b-4e69-b4d5-485cb1184ff9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.151188 Jun 16 15:08:06.483786 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 608/1226] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:06 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:06.849041 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-12408d2e-7352-41c8-b7de-96a6af30bb74 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:06.849688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-12408d2e-7352-41c8-b7de-96a6af30bb74 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:06.856977 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-12408d2e-7352-41c8-b7de-96a6af30bb74 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:06.857418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-12408d2e-7352-41c8-b7de-96a6af30bb74 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:06.858197 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-12408d2e-7352-41c8-b7de-96a6af30bb74 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:06.858627 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-12408d2e-7352-41c8-b7de-96a6af30bb74 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:06.986001 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-12408d2e-7352-41c8-b7de-96a6af30bb74 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:06.993417 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-12408d2e-7352-41c8-b7de-96a6af30bb74 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.148235 Jun 16 15:08:06.993982 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 619/1227] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:08:06 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:08:07.501132 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-db28a937-791d-4804-b741-eaa401cd89c4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:07.501747 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-db28a937-791d-4804-b741-eaa401cd89c4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:07.508298 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-db28a937-791d-4804-b741-eaa401cd89c4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:07.508750 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-db28a937-791d-4804-b741-eaa401cd89c4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:07.509543 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-db28a937-791d-4804-b741-eaa401cd89c4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:07.509984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-db28a937-791d-4804-b741-eaa401cd89c4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:07.639010 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-db28a937-791d-4804-b741-eaa401cd89c4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:07.646827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-db28a937-791d-4804-b741-eaa401cd89c4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:07.648333 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-db28a937-791d-4804-b741-eaa401cd89c4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:07.649526 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-db28a937-791d-4804-b741-eaa401cd89c4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.152351 Jun 16 15:08:07.650080 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 609/1228] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:07 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:08.010432 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d515ef0a-a1c1-47c1-a25f-ebe63edfaafe tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:08.011693 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d515ef0a-a1c1-47c1-a25f-ebe63edfaafe tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:08.018148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d515ef0a-a1c1-47c1-a25f-ebe63edfaafe tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:08.018594 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d515ef0a-a1c1-47c1-a25f-ebe63edfaafe tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:08.019344 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d515ef0a-a1c1-47c1-a25f-ebe63edfaafe tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:08.019776 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d515ef0a-a1c1-47c1-a25f-ebe63edfaafe tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:08.393200 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d515ef0a-a1c1-47c1-a25f-ebe63edfaafe tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:08.400597 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d515ef0a-a1c1-47c1-a25f-ebe63edfaafe tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.394056 Jun 16 15:08:08.401219 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 620/1229] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:08:08 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:08:08.669000 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d80ac139-7fff-4d8d-972a-2c78c9e2e456 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:08.669585 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d80ac139-7fff-4d8d-972a-2c78c9e2e456 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:08.676153 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d80ac139-7fff-4d8d-972a-2c78c9e2e456 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:08.676608 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d80ac139-7fff-4d8d-972a-2c78c9e2e456 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:08.677408 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d80ac139-7fff-4d8d-972a-2c78c9e2e456 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:08.677852 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d80ac139-7fff-4d8d-972a-2c78c9e2e456 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:08.807286 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d80ac139-7fff-4d8d-972a-2c78c9e2e456 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:08.815315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d80ac139-7fff-4d8d-972a-2c78c9e2e456 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:08.816819 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d80ac139-7fff-4d8d-972a-2c78c9e2e456 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:08.818008 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d80ac139-7fff-4d8d-972a-2c78c9e2e456 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.153688 Jun 16 15:08:08.818561 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 610/1230] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:08 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:09.417470 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-aeeb6226-1d26-4935-9d34-87ff91678a03 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:09.418116 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-aeeb6226-1d26-4935-9d34-87ff91678a03 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:09.424587 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aeeb6226-1d26-4935-9d34-87ff91678a03 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:09.425076 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aeeb6226-1d26-4935-9d34-87ff91678a03 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:09.425833 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aeeb6226-1d26-4935-9d34-87ff91678a03 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:09.426267 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aeeb6226-1d26-4935-9d34-87ff91678a03 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:09.555623 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-aeeb6226-1d26-4935-9d34-87ff91678a03 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:09.563475 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-aeeb6226-1d26-4935-9d34-87ff91678a03 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.149896 Jun 16 15:08:09.564032 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 621/1231] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:08:09 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:08:09.835388 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-16dd04b9-fa10-41a6-b3df-9404937e14ff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:09.836001 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-16dd04b9-fa10-41a6-b3df-9404937e14ff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:09.842603 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-16dd04b9-fa10-41a6-b3df-9404937e14ff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:09.843060 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-16dd04b9-fa10-41a6-b3df-9404937e14ff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:09.843828 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-16dd04b9-fa10-41a6-b3df-9404937e14ff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:09.844270 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-16dd04b9-fa10-41a6-b3df-9404937e14ff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:09.972462 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-16dd04b9-fa10-41a6-b3df-9404937e14ff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:09.981102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-16dd04b9-fa10-41a6-b3df-9404937e14ff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:09.982607 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-16dd04b9-fa10-41a6-b3df-9404937e14ff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:09.983766 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-16dd04b9-fa10-41a6-b3df-9404937e14ff tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.152271 Jun 16 15:08:09.984323 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 611/1232] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:09 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:10.580205 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9342bdbf-8e69-438e-b298-8301a0099d50 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:10.580823 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9342bdbf-8e69-438e-b298-8301a0099d50 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:10.587412 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9342bdbf-8e69-438e-b298-8301a0099d50 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:10.587867 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9342bdbf-8e69-438e-b298-8301a0099d50 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:10.589276 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9342bdbf-8e69-438e-b298-8301a0099d50 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:10.589727 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9342bdbf-8e69-438e-b298-8301a0099d50 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:10.720285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9342bdbf-8e69-438e-b298-8301a0099d50 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:10.727733 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9342bdbf-8e69-438e-b298-8301a0099d50 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.151441 Jun 16 15:08:10.728296 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 622/1233] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:08:10 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:08:11.001850 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0db203c0-4483-4733-81f6-a00c5f0ae5e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:11.002458 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0db203c0-4483-4733-81f6-a00c5f0ae5e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:11.008996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0db203c0-4483-4733-81f6-a00c5f0ae5e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:11.009453 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0db203c0-4483-4733-81f6-a00c5f0ae5e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:11.010261 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0db203c0-4483-4733-81f6-a00c5f0ae5e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:11.011291 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0db203c0-4483-4733-81f6-a00c5f0ae5e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:11.142881 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0db203c0-4483-4733-81f6-a00c5f0ae5e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:11.150933 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0db203c0-4483-4733-81f6-a00c5f0ae5e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:11.152440 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0db203c0-4483-4733-81f6-a00c5f0ae5e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:11.153629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0db203c0-4483-4733-81f6-a00c5f0ae5e7 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.155658 Jun 16 15:08:11.154178 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 612/1234] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:10 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:11.743683 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-66478e28-e719-40ec-9f2e-0a7502f648fe tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:11.744295 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-66478e28-e719-40ec-9f2e-0a7502f648fe tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:11.750753 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-66478e28-e719-40ec-9f2e-0a7502f648fe tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:11.751225 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-66478e28-e719-40ec-9f2e-0a7502f648fe tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:11.751973 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-66478e28-e719-40ec-9f2e-0a7502f648fe tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:11.752399 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-66478e28-e719-40ec-9f2e-0a7502f648fe tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:11.879891 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-66478e28-e719-40ec-9f2e-0a7502f648fe tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:11.888030 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-66478e28-e719-40ec-9f2e-0a7502f648fe tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.148148 Jun 16 15:08:11.888588 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 623/1235] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:08:11 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:08:12.181766 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c67340d7-9d12-4a02-a9af-7a9cb73ae369 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:12.183331 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c67340d7-9d12-4a02-a9af-7a9cb73ae369 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:12.189668 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c67340d7-9d12-4a02-a9af-7a9cb73ae369 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:12.190248 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c67340d7-9d12-4a02-a9af-7a9cb73ae369 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:12.191246 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c67340d7-9d12-4a02-a9af-7a9cb73ae369 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:12.191872 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c67340d7-9d12-4a02-a9af-7a9cb73ae369 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:12.319745 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c67340d7-9d12-4a02-a9af-7a9cb73ae369 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:12.328465 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c67340d7-9d12-4a02-a9af-7a9cb73ae369 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:12.330016 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c67340d7-9d12-4a02-a9af-7a9cb73ae369 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:12.331187 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c67340d7-9d12-4a02-a9af-7a9cb73ae369 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.153315 Jun 16 15:08:12.331739 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 613/1236] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:12 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:12.904769 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7274aa40-fd10-4064-88b0-12f353ef623e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:12.905437 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7274aa40-fd10-4064-88b0-12f353ef623e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:12.912195 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7274aa40-fd10-4064-88b0-12f353ef623e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:12.912644 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7274aa40-fd10-4064-88b0-12f353ef623e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:12.913463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7274aa40-fd10-4064-88b0-12f353ef623e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:12.913901 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7274aa40-fd10-4064-88b0-12f353ef623e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:13.056730 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7274aa40-fd10-4064-88b0-12f353ef623e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:13.064232 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7274aa40-fd10-4064-88b0-12f353ef623e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.163396 Jun 16 15:08:13.064795 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 624/1237] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:08:12 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:08:13.348982 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-dd57b528-ee1c-4069-b1a0-f661468a4236 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:13.349618 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-dd57b528-ee1c-4069-b1a0-f661468a4236 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:13.356048 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dd57b528-ee1c-4069-b1a0-f661468a4236 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:13.356495 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dd57b528-ee1c-4069-b1a0-f661468a4236 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:13.357276 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dd57b528-ee1c-4069-b1a0-f661468a4236 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:13.357709 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dd57b528-ee1c-4069-b1a0-f661468a4236 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:13.487407 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-dd57b528-ee1c-4069-b1a0-f661468a4236 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:13.495168 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-dd57b528-ee1c-4069-b1a0-f661468a4236 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:13.496658 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-dd57b528-ee1c-4069-b1a0-f661468a4236 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:13.497944 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-dd57b528-ee1c-4069-b1a0-f661468a4236 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.152904 Jun 16 15:08:13.498498 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 614/1238] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:13 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:14.081052 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7e9af9ce-c75f-4f36-a764-694d82ec1e7a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:14.081652 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7e9af9ce-c75f-4f36-a764-694d82ec1e7a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:14.088124 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7e9af9ce-c75f-4f36-a764-694d82ec1e7a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:14.088565 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7e9af9ce-c75f-4f36-a764-694d82ec1e7a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:14.089348 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7e9af9ce-c75f-4f36-a764-694d82ec1e7a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:14.089777 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7e9af9ce-c75f-4f36-a764-694d82ec1e7a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:14.218379 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7e9af9ce-c75f-4f36-a764-694d82ec1e7a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:14.225786 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7e9af9ce-c75f-4f36-a764-694d82ec1e7a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.148605 Jun 16 15:08:14.226353 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 625/1239] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:08:14 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:08:14.515928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-87c6a80c-2fcc-4f00-9a41-b073c22da86c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:14.516491 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-87c6a80c-2fcc-4f00-9a41-b073c22da86c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:14.523358 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87c6a80c-2fcc-4f00-9a41-b073c22da86c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:14.523846 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87c6a80c-2fcc-4f00-9a41-b073c22da86c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:14.524615 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87c6a80c-2fcc-4f00-9a41-b073c22da86c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:14.525085 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87c6a80c-2fcc-4f00-9a41-b073c22da86c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:14.654127 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-87c6a80c-2fcc-4f00-9a41-b073c22da86c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:14.662462 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-87c6a80c-2fcc-4f00-9a41-b073c22da86c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:14.663999 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-87c6a80c-2fcc-4f00-9a41-b073c22da86c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:14.665184 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-87c6a80c-2fcc-4f00-9a41-b073c22da86c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.153552 Jun 16 15:08:14.665740 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 615/1240] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:14 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:15.243089 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5e19bc50-88bd-4e3a-a32d-800e6282c664 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:15.243642 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5e19bc50-88bd-4e3a-a32d-800e6282c664 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:15.250727 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5e19bc50-88bd-4e3a-a32d-800e6282c664 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:15.251183 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5e19bc50-88bd-4e3a-a32d-800e6282c664 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:15.251948 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5e19bc50-88bd-4e3a-a32d-800e6282c664 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:15.252388 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5e19bc50-88bd-4e3a-a32d-800e6282c664 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:15.380552 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5e19bc50-88bd-4e3a-a32d-800e6282c664 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:15.388580 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5e19bc50-88bd-4e3a-a32d-800e6282c664 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.149460 Jun 16 15:08:15.389175 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 626/1241] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:08:15 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:08:15.684217 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d8ef52f7-325c-4a63-a85a-27912eebad8b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:15.684830 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d8ef52f7-325c-4a63-a85a-27912eebad8b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:15.691410 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d8ef52f7-325c-4a63-a85a-27912eebad8b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:15.691867 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d8ef52f7-325c-4a63-a85a-27912eebad8b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:15.692634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d8ef52f7-325c-4a63-a85a-27912eebad8b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:15.693107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d8ef52f7-325c-4a63-a85a-27912eebad8b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:15.827402 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d8ef52f7-325c-4a63-a85a-27912eebad8b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:15.835438 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d8ef52f7-325c-4a63-a85a-27912eebad8b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:15.836968 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d8ef52f7-325c-4a63-a85a-27912eebad8b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:15.838134 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d8ef52f7-325c-4a63-a85a-27912eebad8b tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.158479 Jun 16 15:08:15.838700 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 616/1242] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:15 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:16.405942 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-56c4e8a1-8f36-4134-8d08-699005d20e1e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:16.406535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-56c4e8a1-8f36-4134-8d08-699005d20e1e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:16.409129 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=58 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:16.414342 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-56c4e8a1-8f36-4134-8d08-699005d20e1e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:16.414791 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-56c4e8a1-8f36-4134-8d08-699005d20e1e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:16.415544 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-56c4e8a1-8f36-4134-8d08-699005d20e1e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:16.415976 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-56c4e8a1-8f36-4134-8d08-699005d20e1e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:16.549981 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-56c4e8a1-8f36-4134-8d08-699005d20e1e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:16.557657 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-56c4e8a1-8f36-4134-8d08-699005d20e1e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.155508 Jun 16 15:08:16.558222 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 627/1243] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:08:16 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:08:16.855929 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6405be55-f924-48d2-b6af-5621491ea37d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:16.856549 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6405be55-f924-48d2-b6af-5621491ea37d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:16.863127 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6405be55-f924-48d2-b6af-5621491ea37d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:16.863582 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6405be55-f924-48d2-b6af-5621491ea37d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:16.864383 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6405be55-f924-48d2-b6af-5621491ea37d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:16.864826 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6405be55-f924-48d2-b6af-5621491ea37d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:16.993000 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6405be55-f924-48d2-b6af-5621491ea37d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:17.001599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6405be55-f924-48d2-b6af-5621491ea37d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:17.003094 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6405be55-f924-48d2-b6af-5621491ea37d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:17.004276 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6405be55-f924-48d2-b6af-5621491ea37d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.152267 Jun 16 15:08:17.004858 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 617/1244] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:16 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:17.574592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7204feb3-90e8-4f79-9431-a4c69075ce3d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:17.575185 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7204feb3-90e8-4f79-9431-a4c69075ce3d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:17.581826 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7204feb3-90e8-4f79-9431-a4c69075ce3d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:17.582278 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7204feb3-90e8-4f79-9431-a4c69075ce3d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:17.583033 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7204feb3-90e8-4f79-9431-a4c69075ce3d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:17.583467 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7204feb3-90e8-4f79-9431-a4c69075ce3d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:17.714635 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7204feb3-90e8-4f79-9431-a4c69075ce3d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:17.722209 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7204feb3-90e8-4f79-9431-a4c69075ce3d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1261 microversion: 2.1 time: 0.151535 Jun 16 15:08:17.722767 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 628/1245] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:08:17 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:08:18.022214 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-881197aa-d86b-447f-9f16-d5f48d002aa2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:18.022837 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-881197aa-d86b-447f-9f16-d5f48d002aa2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:18.030009 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-881197aa-d86b-447f-9f16-d5f48d002aa2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:18.030471 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-881197aa-d86b-447f-9f16-d5f48d002aa2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:18.031237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-881197aa-d86b-447f-9f16-d5f48d002aa2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:18.031680 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-881197aa-d86b-447f-9f16-d5f48d002aa2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:18.162826 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-881197aa-d86b-447f-9f16-d5f48d002aa2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:18.170711 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-881197aa-d86b-447f-9f16-d5f48d002aa2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:18.172220 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-881197aa-d86b-447f-9f16-d5f48d002aa2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:18.173426 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-881197aa-d86b-447f-9f16-d5f48d002aa2 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.155135 Jun 16 15:08:18.173988 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 618/1246] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:18 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:18.739264 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ea7ac163-0a81-4586-b942-b161b0d8e360 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:18.739881 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ea7ac163-0a81-4586-b942-b161b0d8e360 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:18.746748 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ea7ac163-0a81-4586-b942-b161b0d8e360 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:18.746932 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ea7ac163-0a81-4586-b942-b161b0d8e360 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:18.747629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ea7ac163-0a81-4586-b942-b161b0d8e360 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:18.748071 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ea7ac163-0a81-4586-b942-b161b0d8e360 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:18.752035 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:18.779742 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-353f03d0-68e5-4e48-b92e-f6e115b2e91c req-3a15f93e-2786-49fa-8bde-5fe2ad9181e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53e3fc3-e13f-4352-ad2f-7babd83b19e3", "name": "network-vif-plugged", "status": "completed", "tag": "2fd6981b-720b-4e5e-a50b-00f468402a5f"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:08:18.788068 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-353f03d0-68e5-4e48-b92e-f6e115b2e91c req-3a15f93e-2786-49fa-8bde-5fe2ad9181e3 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:18.788503 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-353f03d0-68e5-4e48-b92e-f6e115b2e91c req-3a15f93e-2786-49fa-8bde-5fe2ad9181e3 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:18.800221 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-353f03d0-68e5-4e48-b92e-f6e115b2e91c req-3a15f93e-2786-49fa-8bde-5fe2ad9181e3 service nova] Creating event network-vif-plugged:2fd6981b-720b-4e5e-a50b-00f468402a5f for instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 on hv-cinder-83716 Jun 16 15:08:18.805619 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-353f03d0-68e5-4e48-b92e-f6e115b2e91c req-3a15f93e-2786-49fa-8bde-5fe2ad9181e3 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151690 Jun 16 15:08:18.806223 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 629/1247] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:08:18.878670 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ea7ac163-0a81-4586-b942-b161b0d8e360 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:18.886439 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ea7ac163-0a81-4586-b942-b161b0d8e360 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1445 microversion: 2.1 time: 0.150953 Jun 16 15:08:18.887003 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 619/1248] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:08:18 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1445 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:08:18.902667 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0b34ca4c-249c-433b-90a7-4dfe8821700f tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:18.903367 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0b34ca4c-249c-433b-90a7-4dfe8821700f tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:18.909920 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0b34ca4c-249c-433b-90a7-4dfe8821700f tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:18.910371 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0b34ca4c-249c-433b-90a7-4dfe8821700f tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:18.911123 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0b34ca4c-249c-433b-90a7-4dfe8821700f tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:18.911555 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0b34ca4c-249c-433b-90a7-4dfe8821700f tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:19.047974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0b34ca4c-249c-433b-90a7-4dfe8821700f tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:19.056334 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0b34ca4c-249c-433b-90a7-4dfe8821700f tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1445 microversion: 2.1 time: 0.157696 Jun 16 15:08:19.057081 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 630/1249] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:08:18 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:08:19.191759 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4f376138-69dc-46f7-a56f-6164e9737a14 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:19.192381 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4f376138-69dc-46f7-a56f-6164e9737a14 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:19.198848 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f376138-69dc-46f7-a56f-6164e9737a14 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:19.199291 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f376138-69dc-46f7-a56f-6164e9737a14 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:19.200277 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f376138-69dc-46f7-a56f-6164e9737a14 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:19.200717 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f376138-69dc-46f7-a56f-6164e9737a14 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:19.419062 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4f376138-69dc-46f7-a56f-6164e9737a14 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:19.427041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4f376138-69dc-46f7-a56f-6164e9737a14 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:19.428535 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4f376138-69dc-46f7-a56f-6164e9737a14 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:19.429734 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4f376138-69dc-46f7-a56f-6164e9737a14 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.241933 Jun 16 15:08:19.430293 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 620/1250] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:19 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:20.447718 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-07d4111c-6f5c-4e2a-ae36-d60ede751cea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:20.448282 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-07d4111c-6f5c-4e2a-ae36-d60ede751cea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:20.455276 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-07d4111c-6f5c-4e2a-ae36-d60ede751cea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:20.455726 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-07d4111c-6f5c-4e2a-ae36-d60ede751cea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:20.456500 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-07d4111c-6f5c-4e2a-ae36-d60ede751cea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:20.456976 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-07d4111c-6f5c-4e2a-ae36-d60ede751cea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:20.590022 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-07d4111c-6f5c-4e2a-ae36-d60ede751cea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:20.598224 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-07d4111c-6f5c-4e2a-ae36-d60ede751cea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:20.600553 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-07d4111c-6f5c-4e2a-ae36-d60ede751cea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:20.601775 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-07d4111c-6f5c-4e2a-ae36-d60ede751cea tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.158190 Jun 16 15:08:20.602340 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 631/1251] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:20 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:21.096553 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-81fef7cb-4f42-424b-a754-8c8057dad6ce req-84eb20df-7f24-4c59-8f67-7bc6be8134c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "781db76b-7a5f-47b1-8272-b4868d68c437", "tag": "328671dd-12a3-45cf-9250-1f0f36195bba"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:08:21.100534 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=54 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:21.106258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-81fef7cb-4f42-424b-a754-8c8057dad6ce req-84eb20df-7f24-4c59-8f67-7bc6be8134c4 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:21.106710 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-81fef7cb-4f42-424b-a754-8c8057dad6ce req-84eb20df-7f24-4c59-8f67-7bc6be8134c4 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:21.117940 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-81fef7cb-4f42-424b-a754-8c8057dad6ce req-84eb20df-7f24-4c59-8f67-7bc6be8134c4 service nova] Creating event network-changed:328671dd-12a3-45cf-9250-1f0f36195bba for instance 781db76b-7a5f-47b1-8272-b4868d68c437 on hv-cinder-83716 Jun 16 15:08:21.123269 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-81fef7cb-4f42-424b-a754-8c8057dad6ce req-84eb20df-7f24-4c59-8f67-7bc6be8134c4 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030589 Jun 16 15:08:21.123941 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 621/1252] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:08:21.620404 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d8ff30fb-dcd7-450f-b41b-dc577545b8cc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:21.621077 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d8ff30fb-dcd7-450f-b41b-dc577545b8cc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:21.628112 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d8ff30fb-dcd7-450f-b41b-dc577545b8cc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:21.628561 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d8ff30fb-dcd7-450f-b41b-dc577545b8cc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:21.629353 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d8ff30fb-dcd7-450f-b41b-dc577545b8cc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:21.629827 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d8ff30fb-dcd7-450f-b41b-dc577545b8cc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:21.778907 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d8ff30fb-dcd7-450f-b41b-dc577545b8cc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:21.787487 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d8ff30fb-dcd7-450f-b41b-dc577545b8cc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:21.788936 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d8ff30fb-dcd7-450f-b41b-dc577545b8cc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:21.790098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d8ff30fb-dcd7-450f-b41b-dc577545b8cc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1728 microversion: 2.20 time: 0.174179 Jun 16 15:08:21.790825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 632/1253] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:21 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:22.810430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8d818279-0cb3-4540-8b29-479296a0e107 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:22.811117 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8d818279-0cb3-4540-8b29-479296a0e107 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:22.817524 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8d818279-0cb3-4540-8b29-479296a0e107 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:22.817972 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8d818279-0cb3-4540-8b29-479296a0e107 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:22.818730 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8d818279-0cb3-4540-8b29-479296a0e107 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:22.819163 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8d818279-0cb3-4540-8b29-479296a0e107 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:22.946195 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8d818279-0cb3-4540-8b29-479296a0e107 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:22.954868 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8d818279-0cb3-4540-8b29-479296a0e107 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:22.956372 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8d818279-0cb3-4540-8b29-479296a0e107 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:08:22.957573 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8d818279-0cb3-4540-8b29-479296a0e107 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1715 microversion: 2.20 time: 0.152399 Jun 16 15:08:22.958130 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 622/1254] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:08:22 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:08:38.810347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-af83993c-62a2-47d8-988d-5134f1d3bd55 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:38.811009 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-af83993c-62a2-47d8-988d-5134f1d3bd55 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:38.813327 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=11 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:38.813990 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=95 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:38.819977 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af83993c-62a2-47d8-988d-5134f1d3bd55 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:38.820431 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af83993c-62a2-47d8-988d-5134f1d3bd55 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:38.821232 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af83993c-62a2-47d8-988d-5134f1d3bd55 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:38.821674 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af83993c-62a2-47d8-988d-5134f1d3bd55 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:38.845923 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-af83993c-62a2-47d8-988d-5134f1d3bd55 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/ips" status: 200 len: 145 microversion: 2.1 time: 0.039783 Jun 16 15:08:38.846490 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 633/1255] 10.222.0.72 () {58 vars in 1247 bytes} [Thu Jun 16 15:08:38 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:08:41.202933 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-27315e3d-2e98-458e-a8c2-0ea6628c3634 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc106177-1689-41b2-a099-83bd4fa4f289"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:08:41.204062 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-27315e3d-2e98-458e-a8c2-0ea6628c3634 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:41.206465 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=3 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:41.207213 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=18 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:41.212636 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-27315e3d-2e98-458e-a8c2-0ea6628c3634 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:41.213160 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-27315e3d-2e98-458e-a8c2-0ea6628c3634 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:41.213962 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-27315e3d-2e98-458e-a8c2-0ea6628c3634 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:41.214410 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-27315e3d-2e98-458e-a8c2-0ea6628c3634 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:41.513909 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-27315e3d-2e98-458e-a8c2-0ea6628c3634 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "POST /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315242 Jun 16 15:08:41.514709 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 623/1256] 10.222.0.72 () {60 vars in 1322 bytes} [Thu Jun 16 15:08:41 2022] POST /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:08:49.003226 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-768ce8bf-7424-4975-a4c9-fcebe96b7ff1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:49.004499 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-768ce8bf-7424-4975-a4c9-fcebe96b7ff1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:49.006945 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:49.007675 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=4 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:08:49.013297 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-768ce8bf-7424-4975-a4c9-fcebe96b7ff1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:49.013745 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-768ce8bf-7424-4975-a4c9-fcebe96b7ff1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:49.014500 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-768ce8bf-7424-4975-a4c9-fcebe96b7ff1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:49.014935 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-768ce8bf-7424-4975-a4c9-fcebe96b7ff1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:49.043787 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-768ce8bf-7424-4975-a4c9-fcebe96b7ff1 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045003 Jun 16 15:08:49.044327 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 634/1257] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:08:48 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:08:49.055112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-306dff5f-8cfd-4183-a88a-b6880a28691a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:08:49.055733 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-306dff5f-8cfd-4183-a88a-b6880a28691a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:49.062130 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-306dff5f-8cfd-4183-a88a-b6880a28691a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:49.062577 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-306dff5f-8cfd-4183-a88a-b6880a28691a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:49.063339 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-306dff5f-8cfd-4183-a88a-b6880a28691a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:49.063958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-306dff5f-8cfd-4183-a88a-b6880a28691a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:49.095061 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-306dff5f-8cfd-4183-a88a-b6880a28691a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments/bc106177-1689-41b2-a099-83bd4fa4f289" status: 200 len: 194 microversion: 2.1 time: 0.044688 Jun 16 15:08:49.095559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 624/1258] 10.222.0.72 () {58 vars in 1412 bytes} [Thu Jun 16 15:08:49 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments/bc106177-1689-41b2-a099-83bd4fa4f289 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:08:51.453254 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-964b8dc3-a04c-41be-aa5a-10643ea9d07a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa9177ad-60cc-4ff4-9239-3233c8896055"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:08:51.454305 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-964b8dc3-a04c-41be-aa5a-10643ea9d07a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:08:51.461363 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-964b8dc3-a04c-41be-aa5a-10643ea9d07a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:51.461806 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-964b8dc3-a04c-41be-aa5a-10643ea9d07a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:51.462557 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-964b8dc3-a04c-41be-aa5a-10643ea9d07a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:08:51.462992 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-964b8dc3-a04c-41be-aa5a-10643ea9d07a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:08:51.713847 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-964b8dc3-a04c-41be-aa5a-10643ea9d07a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "POST /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264348 Jun 16 15:08:51.714440 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 635/1259] 10.222.0.72 () {60 vars in 1322 bytes} [Thu Jun 16 15:08:51 2022] POST /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:00.241084 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-09496c41-8f56-48e1-95bc-d99d99443b4a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:00.242067 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-09496c41-8f56-48e1-95bc-d99d99443b4a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:00.244581 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=4 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:00.245274 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:00.250976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-09496c41-8f56-48e1-95bc-d99d99443b4a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:00.251428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-09496c41-8f56-48e1-95bc-d99d99443b4a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:00.252191 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-09496c41-8f56-48e1-95bc-d99d99443b4a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:00.252634 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-09496c41-8f56-48e1-95bc-d99d99443b4a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:00.282427 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-09496c41-8f56-48e1-95bc-d99d99443b4a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045911 Jun 16 15:09:00.283230 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 625/1260] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:09:00 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:00.424106 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9eb76b11-e740-42f0-8e6c-f0ea6a39c36b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:00.424630 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9eb76b11-e740-42f0-8e6c-f0ea6a39c36b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:00.430837 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9eb76b11-e740-42f0-8e6c-f0ea6a39c36b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:00.431317 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9eb76b11-e740-42f0-8e6c-f0ea6a39c36b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:00.432065 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9eb76b11-e740-42f0-8e6c-f0ea6a39c36b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:00.432495 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9eb76b11-e740-42f0-8e6c-f0ea6a39c36b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:00.462180 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9eb76b11-e740-42f0-8e6c-f0ea6a39c36b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments/bc106177-1689-41b2-a099-83bd4fa4f289" status: 200 len: 194 microversion: 2.1 time: 0.043108 Jun 16 15:09:00.462739 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 636/1261] 10.222.0.72 () {58 vars in 1412 bytes} [Thu Jun 16 15:09:00 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments/bc106177-1689-41b2-a099-83bd4fa4f289 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:00.472817 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-67e66fb3-29d2-4bac-8f00-930135726887 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:00.473376 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-67e66fb3-29d2-4bac-8f00-930135726887 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:00.479340 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67e66fb3-29d2-4bac-8f00-930135726887 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:00.479793 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67e66fb3-29d2-4bac-8f00-930135726887 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:00.480557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67e66fb3-29d2-4bac-8f00-930135726887 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:00.481035 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67e66fb3-29d2-4bac-8f00-930135726887 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:00.562002 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-67e66fb3-29d2-4bac-8f00-930135726887 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lazy-loading 'services' on Instance uuid adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:09:00.632329 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-67e66fb3-29d2-4bac-8f00-930135726887 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "DELETE /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments/bc106177-1689-41b2-a099-83bd4fa4f289" status: 202 len: 0 microversion: 2.1 time: 0.163893 Jun 16 15:09:00.632937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 626/1262] 10.222.0.72 () {58 vars in 1415 bytes} [Thu Jun 16 15:09:00 2022] DELETE /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments/bc106177-1689-41b2-a099-83bd4fa4f289 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:09:02.799637 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-989794c0-c8ea-4702-8a49-050beecce8bb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:02.800154 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-989794c0-c8ea-4702-8a49-050beecce8bb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:02.806672 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-989794c0-c8ea-4702-8a49-050beecce8bb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:02.807490 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-989794c0-c8ea-4702-8a49-050beecce8bb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:02.811870 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-989794c0-c8ea-4702-8a49-050beecce8bb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:02.811870 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-989794c0-c8ea-4702-8a49-050beecce8bb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:02.837656 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-989794c0-c8ea-4702-8a49-050beecce8bb tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments/fa9177ad-60cc-4ff4-9239-3233c8896055" status: 200 len: 194 microversion: 2.1 time: 0.041994 Jun 16 15:09:02.838238 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 637/1263] 10.222.0.72 () {58 vars in 1412 bytes} [Thu Jun 16 15:09:02 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments/fa9177ad-60cc-4ff4-9239-3233c8896055 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:02.849429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-51eefd20-c9d5-42b9-babf-6307d0ad0b68 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:02.850053 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-51eefd20-c9d5-42b9-babf-6307d0ad0b68 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:02.856357 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-51eefd20-c9d5-42b9-babf-6307d0ad0b68 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:02.856856 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-51eefd20-c9d5-42b9-babf-6307d0ad0b68 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:02.857635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-51eefd20-c9d5-42b9-babf-6307d0ad0b68 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:02.858078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-51eefd20-c9d5-42b9-babf-6307d0ad0b68 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:02.937760 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-51eefd20-c9d5-42b9-babf-6307d0ad0b68 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lazy-loading 'services' on Instance uuid adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:09:03.006720 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-51eefd20-c9d5-42b9-babf-6307d0ad0b68 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "DELETE /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments/fa9177ad-60cc-4ff4-9239-3233c8896055" status: 202 len: 0 microversion: 2.1 time: 0.162380 Jun 16 15:09:03.007232 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 627/1264] 10.222.0.72 () {58 vars in 1415 bytes} [Thu Jun 16 15:09:02 2022] DELETE /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments/fa9177ad-60cc-4ff4-9239-3233c8896055 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:09:04.168530 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1afa62b1-b994-41f1-ba0e-a59ede7dbb23 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:04.169605 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1afa62b1-b994-41f1-ba0e-a59ede7dbb23 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:04.176169 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1afa62b1-b994-41f1-ba0e-a59ede7dbb23 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:04.176621 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1afa62b1-b994-41f1-ba0e-a59ede7dbb23 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:04.177464 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1afa62b1-b994-41f1-ba0e-a59ede7dbb23 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:04.177926 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1afa62b1-b994-41f1-ba0e-a59ede7dbb23 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:04.205841 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1afa62b1-b994-41f1-ba0e-a59ede7dbb23 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041221 Jun 16 15:09:04.206875 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 638/1265] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:09:04 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 15:09:04.310507 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9dbad11b-50bf-4643-b5de-7d45b68cc84a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:04.311518 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9dbad11b-50bf-4643-b5de-7d45b68cc84a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:04.317784 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9dbad11b-50bf-4643-b5de-7d45b68cc84a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:04.318241 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9dbad11b-50bf-4643-b5de-7d45b68cc84a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:04.319003 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9dbad11b-50bf-4643-b5de-7d45b68cc84a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:04.319443 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9dbad11b-50bf-4643-b5de-7d45b68cc84a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:04.348680 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9dbad11b-50bf-4643-b5de-7d45b68cc84a tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042898 Jun 16 15:09:04.349442 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 628/1266] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:09:04 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 15:09:04.406498 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-70674e48-f740-49d6-ad00-372e2c16d7c0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:04.407004 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-70674e48-f740-49d6-ad00-372e2c16d7c0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:04.413911 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-70674e48-f740-49d6-ad00-372e2c16d7c0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:04.414364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-70674e48-f740-49d6-ad00-372e2c16d7c0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:04.415137 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-70674e48-f740-49d6-ad00-372e2c16d7c0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:04.415578 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-70674e48-f740-49d6-ad00-372e2c16d7c0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:04.439625 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-70674e48-f740-49d6-ad00-372e2c16d7c0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:09:04.517803 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-70674e48-f740-49d6-ad00-372e2c16d7c0 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "DELETE /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 204 len: 0 microversion: 2.1 time: 0.115180 Jun 16 15:09:04.519222 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 639/1267] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:09:04 2022] DELETE /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:09:04.527248 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f7ec183e-801b-469f-9859-56aa819fccc4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:04.527868 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f7ec183e-801b-469f-9859-56aa819fccc4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:04.534118 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f7ec183e-801b-469f-9859-56aa819fccc4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:04.534577 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f7ec183e-801b-469f-9859-56aa819fccc4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:04.535391 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f7ec183e-801b-469f-9859-56aa819fccc4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:04.535797 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f7ec183e-801b-469f-9859-56aa819fccc4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:04.669949 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f7ec183e-801b-469f-9859-56aa819fccc4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:04.677511 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f7ec183e-801b-469f-9859-56aa819fccc4 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 200 len: 1673 microversion: 2.1 time: 0.154138 Jun 16 15:09:04.678071 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 629/1268] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:04 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:05.695481 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-83f97b1c-3aab-4564-9240-9539fe7ed937 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:05.696096 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-83f97b1c-3aab-4564-9240-9539fe7ed937 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:05.702620 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-83f97b1c-3aab-4564-9240-9539fe7ed937 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:05.703074 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-83f97b1c-3aab-4564-9240-9539fe7ed937 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:05.703838 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-83f97b1c-3aab-4564-9240-9539fe7ed937 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:05.704275 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-83f97b1c-3aab-4564-9240-9539fe7ed937 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:05.834803 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-83f97b1c-3aab-4564-9240-9539fe7ed937 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:05.842288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-83f97b1c-3aab-4564-9240-9539fe7ed937 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 200 len: 1673 microversion: 2.1 time: 0.151798 Jun 16 15:09:05.842928 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 640/1269] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:05 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:06.859307 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8a68aa65-d9cf-4453-a2dc-fd7cd96c468b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:06.859852 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8a68aa65-d9cf-4453-a2dc-fd7cd96c468b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:06.866350 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a68aa65-d9cf-4453-a2dc-fd7cd96c468b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:06.866807 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a68aa65-d9cf-4453-a2dc-fd7cd96c468b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:06.867567 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a68aa65-d9cf-4453-a2dc-fd7cd96c468b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:06.868059 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a68aa65-d9cf-4453-a2dc-fd7cd96c468b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:07.039298 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8a68aa65-d9cf-4453-a2dc-fd7cd96c468b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:07.046795 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8a68aa65-d9cf-4453-a2dc-fd7cd96c468b tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 200 len: 1673 microversion: 2.1 time: 0.191424 Jun 16 15:09:07.047358 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 630/1270] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:06 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 1673 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:07.794526 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-0f35c3ad-3639-49b6-a34d-c57af6d478b2 req-a82ed543-925b-4f21-8e59-a3eab7ef6aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc", "name": "network-vif-deleted", "tag": "91200d16-5dc6-4b76-856c-ee259b54b7b7"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:09:07.805124 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-0f35c3ad-3639-49b6-a34d-c57af6d478b2 req-a82ed543-925b-4f21-8e59-a3eab7ef6aa7 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:07.805713 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-0f35c3ad-3639-49b6-a34d-c57af6d478b2 req-a82ed543-925b-4f21-8e59-a3eab7ef6aa7 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:07.819245 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-0f35c3ad-3639-49b6-a34d-c57af6d478b2 req-a82ed543-925b-4f21-8e59-a3eab7ef6aa7 service nova] Creating event network-vif-deleted:91200d16-5dc6-4b76-856c-ee259b54b7b7 for instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc on hv-cinder-83716 Jun 16 15:09:07.824358 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-0f35c3ad-3639-49b6-a34d-c57af6d478b2 req-a82ed543-925b-4f21-8e59-a3eab7ef6aa7 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039094 Jun 16 15:09:07.825121 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 641/1271] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:08.063558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-878c121f-2a1b-4b15-9072-b38b0c01deea tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:08.064179 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-878c121f-2a1b-4b15-9072-b38b0c01deea tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:08.070730 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-878c121f-2a1b-4b15-9072-b38b0c01deea tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:08.071186 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-878c121f-2a1b-4b15-9072-b38b0c01deea tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:08.071955 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-878c121f-2a1b-4b15-9072-b38b0c01deea tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:08.072404 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-878c121f-2a1b-4b15-9072-b38b0c01deea tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:08.106204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-878c121f-2a1b-4b15-9072-b38b0c01deea tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:08.106590 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-878c121f-2a1b-4b15-9072-b38b0c01deea tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:08.107048 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-878c121f-2a1b-4b15-9072-b38b0c01deea tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lazy-loading 'fault' on Instance uuid adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:09:08.147669 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-878c121f-2a1b-4b15-9072-b38b0c01deea tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b424792631ac40f48c3f3c1529d699b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c94142f5fe543e28710c9bb2916662c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:08.155125 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-878c121f-2a1b-4b15-9072-b38b0c01deea tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 200 len: 1327 microversion: 2.1 time: 0.095502 Jun 16 15:09:08.155760 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 631/1272] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:08 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:09.174335 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3715b0ef-6831-4da9-b2f4-cf6813342249 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:09.175534 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3715b0ef-6831-4da9-b2f4-cf6813342249 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:09.181997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3715b0ef-6831-4da9-b2f4-cf6813342249 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:09.182448 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3715b0ef-6831-4da9-b2f4-cf6813342249 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:09.183210 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3715b0ef-6831-4da9-b2f4-cf6813342249 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:09.183647 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3715b0ef-6831-4da9-b2f4-cf6813342249 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:09.196817 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-3715b0ef-6831-4da9-b2f4-cf6813342249 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] HTTP exception thrown: Instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc could not be found. Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3715b0ef-6831-4da9-b2f4-cf6813342249 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Request method failure captured: Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc HTTP/1.1 Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0VWj1cLhR6dixZorVVjO56wH6fMR0eG_PnQ0i6paR4ytJ0P6tqtt_PpXAlgqyXceuBnCFw4egx41E2FUI8eryVn_vNkMKb3uGme4hfWAhyJvVUn-8Rj1e-Zv4pORz8GnKsdT_vPtt00QkGDmBL1Jd8ABHWl1Q6_Z06J02d_hdDL4es Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 3c94142f5fe543e28710c9bb2916662c Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeTestJSON-1611970277 Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 15:09:09.198483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 15:09:09.200153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3c94142f5fe543e28710c9bb2916662c", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c94142f5fe543e28710c9bb2916662c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c94142f5fe543e28710c9bb2916662c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3c94142f5fe543e28710c9bb2916662c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:09:09.200153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeTestJSON-1611970277 Jun 16 15:09:09.200153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 3c94142f5fe543e28710c9bb2916662c Jun 16 15:09:09.200153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1611970277 Jun 16 15:09:09.200153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeTestJSON-1611970277-project Jun 16 15:09:09.200153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 15:09:09.200153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 15:09:09.200153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: b424792631ac40f48c3f3c1529d699b3 Jun 16 15:09:09.200153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeTestJSON-1611970277-project Jun 16 15:09:09.200153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 15:09:09.200153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc could not be found. Jun 16 15:09:09.200153 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': 'adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc'} Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc could not be found. Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:09:09.201031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:09:09.202533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:09:09.202533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:09:09.202533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:09:09.202533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:09:09.202533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:09:09.202533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:09:09.202533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:09:09.202533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc could not be found. Jun 16 15:09:09.202533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:09.202533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:09.202533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:09.202533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:09.202533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:09.202533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:09.202533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:09:09.202533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:09:09.202533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc could not be found. Jun 16 15:09:09.202533 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:09.203905 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3715b0ef-6831-4da9-b2f4-cf6813342249 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Returning 404 to user: Instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:09:09.203905 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3715b0ef-6831-4da9-b2f4-cf6813342249 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 404 len: 111 microversion: 2.1 time: 0.030348 Jun 16 15:09:09.203905 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 642/1273] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:09 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:09:09.208629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-634bc905-ed1a-4eaf-a95d-24c73bb30911 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '.version_select at 0x7faab6376160>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:09.227023 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-634bc905-ed1a-4eaf-a95d-24c73bb30911 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-794601268" status: 202 len: 0 microversion: 2.1 time: 0.022191 Jun 16 15:09:09.227575 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 632/1274] 10.222.0.72 () {58 vars in 1217 bytes} [Thu Jun 16 15:09:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-794601268 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:09:12.101367 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9a646ac8-e405-4ac9-9933-86899ce77abf tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:12.101851 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9a646ac8-e405-4ac9-9933-86899ce77abf tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:12.108381 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a646ac8-e405-4ac9-9933-86899ce77abf tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:12.108829 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a646ac8-e405-4ac9-9933-86899ce77abf tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:12.109607 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a646ac8-e405-4ac9-9933-86899ce77abf tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:12.110042 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a646ac8-e405-4ac9-9933-86899ce77abf tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:12.123667 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-9a646ac8-e405-4ac9-9933-86899ce77abf tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] HTTP exception thrown: Instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc could not be found. Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9a646ac8-e405-4ac9-9933-86899ce77abf tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Request method failure captured: Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: DELETE /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc HTTP/1.1 Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0VWj1cLhR6dixZorVVjO56wH6fMR0eG_PnQ0i6paR4ytJ0P6tqtt_PpXAlgqyXceuBnCFw4egx41E2FUI8eryVn_vNkMKb3uGme4hfWAhyJvVUn-8Rj1e-Zv4pORz8GnKsdT_vPtt00QkGDmBL1Jd8ABHWl1Q6_Z06J02d_hdDL4es Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 3c94142f5fe543e28710c9bb2916662c Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeTestJSON-1611970277 Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 15:09:12.125236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 15:09:12.126836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3c94142f5fe543e28710c9bb2916662c", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c94142f5fe543e28710c9bb2916662c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c94142f5fe543e28710c9bb2916662c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3c94142f5fe543e28710c9bb2916662c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:09:12.126836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeTestJSON-1611970277 Jun 16 15:09:12.126836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 3c94142f5fe543e28710c9bb2916662c Jun 16 15:09:12.126836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1611970277 Jun 16 15:09:12.126836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeTestJSON-1611970277-project Jun 16 15:09:12.126836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 15:09:12.126836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 15:09:12.126836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: b424792631ac40f48c3f3c1529d699b3 Jun 16 15:09:12.126836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeTestJSON-1611970277-project Jun 16 15:09:12.126836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 15:09:12.126836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc could not be found. Jun 16 15:09:12.126836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': 'adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc'} Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc could not be found. Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:09:12.127650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc could not be found. Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc could not be found. Jun 16 15:09:12.128951 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:12.130416 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9a646ac8-e405-4ac9-9933-86899ce77abf tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Returning 404 to user: Instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:09:12.130416 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9a646ac8-e405-4ac9-9933-86899ce77abf tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "DELETE /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 404 len: 111 microversion: 2.1 time: 0.029200 Jun 16 15:09:12.130416 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 643/1275] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:09:12 2022] DELETE /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:09:12.135929 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-541cf9ea-2e93-4102-85f8-e0e82f588e92 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:12.136496 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-541cf9ea-2e93-4102-85f8-e0e82f588e92 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:12.143166 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-541cf9ea-2e93-4102-85f8-e0e82f588e92 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:12.143621 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-541cf9ea-2e93-4102-85f8-e0e82f588e92 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:12.144379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-541cf9ea-2e93-4102-85f8-e0e82f588e92 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:12.144819 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-541cf9ea-2e93-4102-85f8-e0e82f588e92 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:12.157989 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-541cf9ea-2e93-4102-85f8-e0e82f588e92 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] HTTP exception thrown: Instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc could not be found. Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-541cf9ea-2e93-4102-85f8-e0e82f588e92 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Request method failure captured: Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc HTTP/1.1 Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0VWj1cLhR6dixZorVVjO56wH6fMR0eG_PnQ0i6paR4ytJ0P6tqtt_PpXAlgqyXceuBnCFw4egx41E2FUI8eryVn_vNkMKb3uGme4hfWAhyJvVUn-8Rj1e-Zv4pORz8GnKsdT_vPtt00QkGDmBL1Jd8ABHWl1Q6_Z06J02d_hdDL4es Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 3c94142f5fe543e28710c9bb2916662c Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeTestJSON-1611970277 Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:09:12.160112 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:09:12.161789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3c94142f5fe543e28710c9bb2916662c", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c94142f5fe543e28710c9bb2916662c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c94142f5fe543e28710c9bb2916662c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3c94142f5fe543e28710c9bb2916662c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:09:12.161789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeTestJSON-1611970277 Jun 16 15:09:12.161789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 3c94142f5fe543e28710c9bb2916662c Jun 16 15:09:12.161789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1611970277 Jun 16 15:09:12.161789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeTestJSON-1611970277-project Jun 16 15:09:12.161789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:09:12.161789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:09:12.161789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: b424792631ac40f48c3f3c1529d699b3 Jun 16 15:09:12.161789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeTestJSON-1611970277-project Jun 16 15:09:12.161789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:09:12.161789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc could not be found. Jun 16 15:09:12.161789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': 'adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc'} Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc could not be found. Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:09:12.162767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:09:12.164258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:09:12.164258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:09:12.164258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:09:12.164258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:09:12.164258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:09:12.164258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:09:12.164258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:09:12.164258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc could not be found. Jun 16 15:09:12.164258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:12.164258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:12.164258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:12.164258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:12.164258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:12.164258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:12.164258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:09:12.164258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:09:12.164258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc could not be found. Jun 16 15:09:12.164258 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:12.165697 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-541cf9ea-2e93-4102-85f8-e0e82f588e92 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Returning 404 to user: Instance adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:09:12.165697 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-541cf9ea-2e93-4102-85f8-e0e82f588e92 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc" status: 404 len: 111 microversion: 2.1 time: 0.030109 Jun 16 15:09:12.165697 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 633/1276] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:12 2022] GET /compute/v2.1/servers/adb57121-52c3-4ff0-bc1c-6ce46cc1f5dc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:09:13.295092 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-388bf67e-7ab3-4e2b-8cc2-de7959b78679 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:13.295571 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-388bf67e-7ab3-4e2b-8cc2-de7959b78679 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:13.302630 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-388bf67e-7ab3-4e2b-8cc2-de7959b78679 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:13.303079 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-388bf67e-7ab3-4e2b-8cc2-de7959b78679 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:13.303838 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-388bf67e-7ab3-4e2b-8cc2-de7959b78679 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:13.304274 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-388bf67e-7ab3-4e2b-8cc2-de7959b78679 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:13.318130 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-388bf67e-7ab3-4e2b-8cc2-de7959b78679 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] HTTP exception thrown: Instance 34992108-bb48-4184-88ee-43907b8b14a3 could not be found. Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-388bf67e-7ab3-4e2b-8cc2-de7959b78679 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Request method failure captured: Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: DELETE /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 HTTP/1.1 Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0VWj1cLhR6dixZorVVjO56wH6fMR0eG_PnQ0i6paR4ytJ0P6tqtt_PpXAlgqyXceuBnCFw4egx41E2FUI8eryVn_vNkMKb3uGme4hfWAhyJvVUn-8Rj1e-Zv4pORz8GnKsdT_vPtt00QkGDmBL1Jd8ABHWl1Q6_Z06J02d_hdDL4es Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 3c94142f5fe543e28710c9bb2916662c Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeTestJSON-1611970277 Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 15:09:13.319671 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 15:09:13.321115 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3c94142f5fe543e28710c9bb2916662c", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c94142f5fe543e28710c9bb2916662c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c94142f5fe543e28710c9bb2916662c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3c94142f5fe543e28710c9bb2916662c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:09:13.321115 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeTestJSON-1611970277 Jun 16 15:09:13.321115 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 3c94142f5fe543e28710c9bb2916662c Jun 16 15:09:13.321115 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1611970277 Jun 16 15:09:13.321115 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeTestJSON-1611970277-project Jun 16 15:09:13.321115 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 15:09:13.321115 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 15:09:13.321115 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: b424792631ac40f48c3f3c1529d699b3 Jun 16 15:09:13.321115 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeTestJSON-1611970277-project Jun 16 15:09:13.321115 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 15:09:13.321115 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance 34992108-bb48-4184-88ee-43907b8b14a3 could not be found. Jun 16 15:09:13.321115 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': '34992108-bb48-4184-88ee-43907b8b14a3'} Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34992108-bb48-4184-88ee-43907b8b14a3 could not be found. Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:09:13.321873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34992108-bb48-4184-88ee-43907b8b14a3 could not be found. Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34992108-bb48-4184-88ee-43907b8b14a3 could not be found. Jun 16 15:09:13.323148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:13.324370 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-388bf67e-7ab3-4e2b-8cc2-de7959b78679 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Returning 404 to user: Instance 34992108-bb48-4184-88ee-43907b8b14a3 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:09:13.324370 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-388bf67e-7ab3-4e2b-8cc2-de7959b78679 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "DELETE /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 404 len: 111 microversion: 2.1 time: 0.029819 Jun 16 15:09:13.324370 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 644/1277] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:09:13 2022] DELETE /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:09:13.329533 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-aa4141d8-c4c3-4d4e-8c1a-7699b66a5d39 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:13.330151 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-aa4141d8-c4c3-4d4e-8c1a-7699b66a5d39 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] [instance: 34992108-bb48-4184-88ee-43907b8b14a3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:13.336709 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aa4141d8-c4c3-4d4e-8c1a-7699b66a5d39 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:13.337198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aa4141d8-c4c3-4d4e-8c1a-7699b66a5d39 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:13.337965 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aa4141d8-c4c3-4d4e-8c1a-7699b66a5d39 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:13.338408 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aa4141d8-c4c3-4d4e-8c1a-7699b66a5d39 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:13.351782 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-aa4141d8-c4c3-4d4e-8c1a-7699b66a5d39 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] HTTP exception thrown: Instance 34992108-bb48-4184-88ee-43907b8b14a3 could not be found. Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-aa4141d8-c4c3-4d4e-8c1a-7699b66a5d39 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Request method failure captured: Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 HTTP/1.1 Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0VWj1cLhR6dixZorVVjO56wH6fMR0eG_PnQ0i6paR4ytJ0P6tqtt_PpXAlgqyXceuBnCFw4egx41E2FUI8eryVn_vNkMKb3uGme4hfWAhyJvVUn-8Rj1e-Zv4pORz8GnKsdT_vPtt00QkGDmBL1Jd8ABHWl1Q6_Z06J02d_hdDL4es Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 3c94142f5fe543e28710c9bb2916662c Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeTestJSON-1611970277 Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:09:13.353128 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:09:13.355409 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3c94142f5fe543e28710c9bb2916662c", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c94142f5fe543e28710c9bb2916662c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3c94142f5fe543e28710c9bb2916662c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3c94142f5fe543e28710c9bb2916662c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:09:13.355409 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeTestJSON-1611970277 Jun 16 15:09:13.355409 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 3c94142f5fe543e28710c9bb2916662c Jun 16 15:09:13.355409 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1611970277 Jun 16 15:09:13.355409 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeTestJSON-1611970277-project Jun 16 15:09:13.355409 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:09:13.355409 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:09:13.355409 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: b424792631ac40f48c3f3c1529d699b3 Jun 16 15:09:13.355409 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeTestJSON-1611970277-project Jun 16 15:09:13.355409 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:09:13.355409 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance 34992108-bb48-4184-88ee-43907b8b14a3 could not be found. Jun 16 15:09:13.355409 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': '34992108-bb48-4184-88ee-43907b8b14a3'} Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34992108-bb48-4184-88ee-43907b8b14a3 could not be found. Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:09:13.356650 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:09:13.358243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:09:13.358243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:09:13.358243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:09:13.358243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:09:13.358243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:09:13.358243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:09:13.358243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:09:13.358243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34992108-bb48-4184-88ee-43907b8b14a3 could not be found. Jun 16 15:09:13.358243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:13.358243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:13.358243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:13.358243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:13.358243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:13.358243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:13.358243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:09:13.358243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:09:13.358243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34992108-bb48-4184-88ee-43907b8b14a3 could not be found. Jun 16 15:09:13.358243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:13.359745 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-aa4141d8-c4c3-4d4e-8c1a-7699b66a5d39 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] Returning 404 to user: Instance 34992108-bb48-4184-88ee-43907b8b14a3 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:09:13.359745 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-aa4141d8-c4c3-4d4e-8c1a-7699b66a5d39 tempest-AttachVolumeTestJSON-1611970277 tempest-AttachVolumeTestJSON-1611970277-project] 10.222.0.72 "GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3" status: 404 len: 111 microversion: 2.1 time: 0.028789 Jun 16 15:09:13.359745 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 634/1278] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:13 2022] GET /compute/v2.1/servers/34992108-bb48-4184-88ee-43907b8b14a3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 15:09:19.899799 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e2010d28-fa68-4bff-849c-6bf26af71d4a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:19.900413 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e2010d28-fa68-4bff-849c-6bf26af71d4a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:19.902985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:19.908461 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e2010d28-fa68-4bff-849c-6bf26af71d4a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:19.909525 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e2010d28-fa68-4bff-849c-6bf26af71d4a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:19.910326 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e2010d28-fa68-4bff-849c-6bf26af71d4a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:19.910794 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e2010d28-fa68-4bff-849c-6bf26af71d4a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:19.914743 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:19.938440 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e2010d28-fa68-4bff-849c-6bf26af71d4a tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/ips" status: 200 len: 149 microversion: 2.1 time: 0.042508 Jun 16 15:09:19.939017 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 645/1279] 10.222.0.72 () {58 vars in 1247 bytes} [Thu Jun 16 15:09:19 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:22.311853 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3cc791cf-8294-457e-bb12-1d3a7fa314b8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a6c5c16-e432-4294-9e45-f078c1a35516"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:09:22.312953 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3cc791cf-8294-457e-bb12-1d3a7fa314b8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:22.320223 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3cc791cf-8294-457e-bb12-1d3a7fa314b8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:22.320673 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3cc791cf-8294-457e-bb12-1d3a7fa314b8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:22.321472 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3cc791cf-8294-457e-bb12-1d3a7fa314b8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:22.321906 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3cc791cf-8294-457e-bb12-1d3a7fa314b8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:22.588285 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3cc791cf-8294-457e-bb12-1d3a7fa314b8 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "POST /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280373 Jun 16 15:09:22.589108 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 635/1280] 10.222.0.72 () {60 vars in 1322 bytes} [Thu Jun 16 15:09:22 2022] POST /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:30.177770 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7d29a4f8-187e-42ff-ad3c-305e9d545a03 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:30.178296 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7d29a4f8-187e-42ff-ad3c-305e9d545a03 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:30.180697 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:30.181387 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:30.186956 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7d29a4f8-187e-42ff-ad3c-305e9d545a03 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:30.187405 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7d29a4f8-187e-42ff-ad3c-305e9d545a03 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:30.188162 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7d29a4f8-187e-42ff-ad3c-305e9d545a03 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:30.188597 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7d29a4f8-187e-42ff-ad3c-305e9d545a03 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:30.267634 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-7d29a4f8-187e-42ff-ad3c-305e9d545a03 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lazy-loading 'services' on Instance uuid 0fdfccb3-ca19-46af-91ee-db50006827ac {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:09:30.336511 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7d29a4f8-187e-42ff-ad3c-305e9d545a03 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "DELETE /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-volume_attachments/1a6c5c16-e432-4294-9e45-f078c1a35516" status: 202 len: 0 microversion: 2.1 time: 0.163226 Jun 16 15:09:30.337178 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 646/1281] 10.222.0.72 () {58 vars in 1415 bytes} [Thu Jun 16 15:09:30 2022] DELETE /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-volume_attachments/1a6c5c16-e432-4294-9e45-f078c1a35516 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:09:30.347127 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c56e75b9-ad70-4d9b-a22d-1863fcb823f6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:30.348134 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c56e75b9-ad70-4d9b-a22d-1863fcb823f6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:30.350302 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:30.355765 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c56e75b9-ad70-4d9b-a22d-1863fcb823f6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:30.356214 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c56e75b9-ad70-4d9b-a22d-1863fcb823f6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:30.357021 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c56e75b9-ad70-4d9b-a22d-1863fcb823f6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:30.357468 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c56e75b9-ad70-4d9b-a22d-1863fcb823f6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:30.360299 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=66,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:30.389181 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c56e75b9-ad70-4d9b-a22d-1863fcb823f6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047324 Jun 16 15:09:30.389647 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 636/1282] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:09:30 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:31.402338 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f8f0b35f-5d19-45c5-a251-cf20b10ee3fe tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:31.403339 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f8f0b35f-5d19-45c5-a251-cf20b10ee3fe tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:31.410425 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f8f0b35f-5d19-45c5-a251-cf20b10ee3fe tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:31.410873 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f8f0b35f-5d19-45c5-a251-cf20b10ee3fe tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:31.411633 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f8f0b35f-5d19-45c5-a251-cf20b10ee3fe tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:31.412065 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f8f0b35f-5d19-45c5-a251-cf20b10ee3fe tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:31.440327 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f8f0b35f-5d19-45c5-a251-cf20b10ee3fe tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043102 Jun 16 15:09:31.440796 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 647/1283] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:09:31 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:32.451834 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-52c8f3dc-dc85-4311-8d30-2f4ef4b24e9d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:32.452708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-52c8f3dc-dc85-4311-8d30-2f4ef4b24e9d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:32.459860 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-52c8f3dc-dc85-4311-8d30-2f4ef4b24e9d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:32.460304 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-52c8f3dc-dc85-4311-8d30-2f4ef4b24e9d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:32.461099 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-52c8f3dc-dc85-4311-8d30-2f4ef4b24e9d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:32.461541 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-52c8f3dc-dc85-4311-8d30-2f4ef4b24e9d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:32.489265 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-52c8f3dc-dc85-4311-8d30-2f4ef4b24e9d tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041444 Jun 16 15:09:32.489807 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 637/1284] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:09:32 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:33.500078 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-999cc7b6-7975-460c-b907-290ee6505e80 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:33.501039 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-999cc7b6-7975-460c-b907-290ee6505e80 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:33.507768 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-999cc7b6-7975-460c-b907-290ee6505e80 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:33.508248 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-999cc7b6-7975-460c-b907-290ee6505e80 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:33.509037 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-999cc7b6-7975-460c-b907-290ee6505e80 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:33.509476 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-999cc7b6-7975-460c-b907-290ee6505e80 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:33.537982 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-999cc7b6-7975-460c-b907-290ee6505e80 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041929 Jun 16 15:09:33.538526 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 648/1285] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:09:33 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:34.550239 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ed154661-97a5-4379-bb94-01de3b6e8b42 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:34.551298 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ed154661-97a5-4379-bb94-01de3b6e8b42 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:34.557885 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ed154661-97a5-4379-bb94-01de3b6e8b42 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:34.558340 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ed154661-97a5-4379-bb94-01de3b6e8b42 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:34.559117 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ed154661-97a5-4379-bb94-01de3b6e8b42 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:34.559556 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ed154661-97a5-4379-bb94-01de3b6e8b42 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:34.589592 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ed154661-97a5-4379-bb94-01de3b6e8b42 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043228 Jun 16 15:09:34.590146 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 638/1286] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:09:34 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:35.600762 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-36bd7870-2cc4-4d33-b776-a299f1d12a31 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:35.601748 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-36bd7870-2cc4-4d33-b776-a299f1d12a31 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:35.608180 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-36bd7870-2cc4-4d33-b776-a299f1d12a31 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:35.608615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-36bd7870-2cc4-4d33-b776-a299f1d12a31 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:35.609400 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-36bd7870-2cc4-4d33-b776-a299f1d12a31 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:35.609832 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-36bd7870-2cc4-4d33-b776-a299f1d12a31 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:35.638990 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-36bd7870-2cc4-4d33-b776-a299f1d12a31 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042167 Jun 16 15:09:35.639532 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 649/1287] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:09:35 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:36.650838 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d0e046f2-2ad0-4a13-a56f-7aaa8c4babd6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:36.651828 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d0e046f2-2ad0-4a13-a56f-7aaa8c4babd6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:36.658514 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d0e046f2-2ad0-4a13-a56f-7aaa8c4babd6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:36.658980 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d0e046f2-2ad0-4a13-a56f-7aaa8c4babd6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:36.659719 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d0e046f2-2ad0-4a13-a56f-7aaa8c4babd6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:36.660651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d0e046f2-2ad0-4a13-a56f-7aaa8c4babd6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:36.689338 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d0e046f2-2ad0-4a13-a56f-7aaa8c4babd6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042483 Jun 16 15:09:36.689888 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 639/1288] 10.222.0.72 () {58 vars in 1301 bytes} [Thu Jun 16 15:09:36 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 15:09:36.746629 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-62456bc2-1404-4f00-9fa3-687c1f9b2e04 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:36.747123 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-62456bc2-1404-4f00-9fa3-687c1f9b2e04 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:36.753584 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-62456bc2-1404-4f00-9fa3-687c1f9b2e04 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:36.754058 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-62456bc2-1404-4f00-9fa3-687c1f9b2e04 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:36.754808 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-62456bc2-1404-4f00-9fa3-687c1f9b2e04 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:36.755236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-62456bc2-1404-4f00-9fa3-687c1f9b2e04 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:36.780190 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-62456bc2-1404-4f00-9fa3-687c1f9b2e04 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:09:36.856653 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-62456bc2-1404-4f00-9fa3-687c1f9b2e04 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "DELETE /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 204 len: 0 microversion: 2.1 time: 0.112934 Jun 16 15:09:36.857496 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 650/1289] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:09:36 2022] DELETE /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:09:36.867028 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8c660592-ed76-40b6-8ee7-001e1c5d9a0f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:36.867665 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8c660592-ed76-40b6-8ee7-001e1c5d9a0f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:36.873583 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c660592-ed76-40b6-8ee7-001e1c5d9a0f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:36.874029 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c660592-ed76-40b6-8ee7-001e1c5d9a0f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:36.874782 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c660592-ed76-40b6-8ee7-001e1c5d9a0f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:36.875216 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8c660592-ed76-40b6-8ee7-001e1c5d9a0f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:37.012512 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8c660592-ed76-40b6-8ee7-001e1c5d9a0f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:37.020562 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8c660592-ed76-40b6-8ee7-001e1c5d9a0f tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1680 microversion: 2.1 time: 0.158606 Jun 16 15:09:37.021159 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 640/1290] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:36 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:09:38.039154 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c76ac35a-96a5-4858-8ce4-f04b843d7d58 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:38.039933 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c76ac35a-96a5-4858-8ce4-f04b843d7d58 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:38.046516 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c76ac35a-96a5-4858-8ce4-f04b843d7d58 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:38.046966 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c76ac35a-96a5-4858-8ce4-f04b843d7d58 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:38.047820 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c76ac35a-96a5-4858-8ce4-f04b843d7d58 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:38.048257 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c76ac35a-96a5-4858-8ce4-f04b843d7d58 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:38.176772 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c76ac35a-96a5-4858-8ce4-f04b843d7d58 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:38.184558 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c76ac35a-96a5-4858-8ce4-f04b843d7d58 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1680 microversion: 2.1 time: 0.149388 Jun 16 15:09:38.185717 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 651/1291] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:38 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:39.202336 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-291854ad-6a32-4bbe-9e27-1b30c4cdb30e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:39.202887 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-291854ad-6a32-4bbe-9e27-1b30c4cdb30e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:39.209944 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-291854ad-6a32-4bbe-9e27-1b30c4cdb30e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:39.210400 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-291854ad-6a32-4bbe-9e27-1b30c4cdb30e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:39.211588 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-291854ad-6a32-4bbe-9e27-1b30c4cdb30e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:39.212041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-291854ad-6a32-4bbe-9e27-1b30c4cdb30e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:39.342931 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-291854ad-6a32-4bbe-9e27-1b30c4cdb30e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:39.350953 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-291854ad-6a32-4bbe-9e27-1b30c4cdb30e tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1680 microversion: 2.1 time: 0.152656 Jun 16 15:09:39.351666 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 641/1292] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:39 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:40.368132 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a1c95d25-62cb-4fd6-8ea2-d35def5fa661 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:40.368746 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a1c95d25-62cb-4fd6-8ea2-d35def5fa661 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:40.375495 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a1c95d25-62cb-4fd6-8ea2-d35def5fa661 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:40.375948 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a1c95d25-62cb-4fd6-8ea2-d35def5fa661 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:40.376710 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a1c95d25-62cb-4fd6-8ea2-d35def5fa661 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:40.377180 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a1c95d25-62cb-4fd6-8ea2-d35def5fa661 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:40.503006 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a1c95d25-62cb-4fd6-8ea2-d35def5fa661 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:40.510473 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a1c95d25-62cb-4fd6-8ea2-d35def5fa661 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1680 microversion: 2.1 time: 0.146883 Jun 16 15:09:40.511043 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 652/1293] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:40 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1680 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:41.527646 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a8297f0e-50e2-4843-b5a6-149d4d295ce0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:41.528231 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a8297f0e-50e2-4843-b5a6-149d4d295ce0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:41.535321 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8297f0e-50e2-4843-b5a6-149d4d295ce0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:41.535783 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8297f0e-50e2-4843-b5a6-149d4d295ce0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:41.536554 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8297f0e-50e2-4843-b5a6-149d4d295ce0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:41.537036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8297f0e-50e2-4843-b5a6-149d4d295ce0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:41.664682 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a8297f0e-50e2-4843-b5a6-149d4d295ce0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:41.672704 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a8297f0e-50e2-4843-b5a6-149d4d295ce0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1680 microversion: 2.1 time: 0.149063 Jun 16 15:09:41.673302 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 642/1294] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:41 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:42.690011 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f83401c7-014b-4981-bd03-f300e947c844 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:42.690654 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f83401c7-014b-4981-bd03-f300e947c844 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:42.697834 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f83401c7-014b-4981-bd03-f300e947c844 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:42.698279 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f83401c7-014b-4981-bd03-f300e947c844 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:42.699047 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f83401c7-014b-4981-bd03-f300e947c844 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:42.699507 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f83401c7-014b-4981-bd03-f300e947c844 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:42.831876 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f83401c7-014b-4981-bd03-f300e947c844 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:42.840250 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f83401c7-014b-4981-bd03-f300e947c844 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1680 microversion: 2.1 time: 0.154077 Jun 16 15:09:42.840808 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 653/1295] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:42 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:43.859430 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ecbb056b-0311-443a-8af2-6ecd79b2ebcc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:43.860337 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ecbb056b-0311-443a-8af2-6ecd79b2ebcc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:43.871996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecbb056b-0311-443a-8af2-6ecd79b2ebcc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:43.872644 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecbb056b-0311-443a-8af2-6ecd79b2ebcc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:43.873851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecbb056b-0311-443a-8af2-6ecd79b2ebcc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:43.874580 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecbb056b-0311-443a-8af2-6ecd79b2ebcc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:44.108764 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ecbb056b-0311-443a-8af2-6ecd79b2ebcc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:44.117514 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ecbb056b-0311-443a-8af2-6ecd79b2ebcc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1680 microversion: 2.1 time: 0.263014 Jun 16 15:09:44.118204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 643/1296] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:43 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1680 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:44.902469 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-b65a6222-8a96-4268-8d9d-b24056d88353 req-cacbf65b-f50d-4d6b-ba57-0cb731fe6db6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdfccb3-ca19-46af-91ee-db50006827ac", "name": "network-vif-deleted", "tag": "c40f32fc-ed69-4d0e-ae9b-74cae93701f8"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:09:44.915769 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-b65a6222-8a96-4268-8d9d-b24056d88353 req-cacbf65b-f50d-4d6b-ba57-0cb731fe6db6 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:44.916224 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-b65a6222-8a96-4268-8d9d-b24056d88353 req-cacbf65b-f50d-4d6b-ba57-0cb731fe6db6 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:44.935165 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-b65a6222-8a96-4268-8d9d-b24056d88353 req-cacbf65b-f50d-4d6b-ba57-0cb731fe6db6 service nova] Creating event network-vif-deleted:c40f32fc-ed69-4d0e-ae9b-74cae93701f8 for instance 0fdfccb3-ca19-46af-91ee-db50006827ac on hv-cinder-83716 Jun 16 15:09:44.943007 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-b65a6222-8a96-4268-8d9d-b24056d88353 req-cacbf65b-f50d-4d6b-ba57-0cb731fe6db6 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226277 Jun 16 15:09:44.943851 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 654/1297] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:45.136626 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8784fb34-6c80-46b6-83c2-03bd71ef8ebd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:45.137404 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8784fb34-6c80-46b6-83c2-03bd71ef8ebd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:45.146725 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8784fb34-6c80-46b6-83c2-03bd71ef8ebd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:45.147414 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8784fb34-6c80-46b6-83c2-03bd71ef8ebd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:45.148523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8784fb34-6c80-46b6-83c2-03bd71ef8ebd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:45.149202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8784fb34-6c80-46b6-83c2-03bd71ef8ebd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:45.227454 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8784fb34-6c80-46b6-83c2-03bd71ef8ebd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:45.228213 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8784fb34-6c80-46b6-83c2-03bd71ef8ebd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:45.229408 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-8784fb34-6c80-46b6-83c2-03bd71ef8ebd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lazy-loading 'fault' on Instance uuid 0fdfccb3-ca19-46af-91ee-db50006827ac {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:09:45.276153 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8784fb34-6c80-46b6-83c2-03bd71ef8ebd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b8be0ab53ae48af844bc281dee5f77c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2940b81a86c2401db1aa432d9a0735eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:45.284152 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8784fb34-6c80-46b6-83c2-03bd71ef8ebd tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 200 len: 1331 microversion: 2.1 time: 0.152526 Jun 16 15:09:45.285084 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 644/1298] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:45 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 1331 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:46.303897 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-abe36f86-09be-4298-b988-274f065838e0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:46.304628 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-abe36f86-09be-4298-b988-274f065838e0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:46.310862 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-abe36f86-09be-4298-b988-274f065838e0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:46.311318 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-abe36f86-09be-4298-b988-274f065838e0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:46.312074 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-abe36f86-09be-4298-b988-274f065838e0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:46.312513 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-abe36f86-09be-4298-b988-274f065838e0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:46.325705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-abe36f86-09be-4298-b988-274f065838e0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] HTTP exception thrown: Instance 0fdfccb3-ca19-46af-91ee-db50006827ac could not be found. Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-abe36f86-09be-4298-b988-274f065838e0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Request method failure captured: Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac HTTP/1.1 Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0TU2Gjo7bUkrQIinrAEmUizdcavVo4cOx7_e9CBdhqQMOL_HN88fbcSkNjz0fxmjx2YzvDmjFBGY4yiPbtaUHC4qF4lZPrXQHcA8kaogkzbM_Pr4t5ixnvBhbj3OMnQtdL4-hEGTH3GzOC14o5hpUT2K4iK3ilxCwb3lslIqMZDzIU Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 15:09:46.327309 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 15:09:46.329045 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2940b81a86c2401db1aa432d9a0735eb", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:09:46.329045 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:46.329045 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:09:46.329045 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:46.329045 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:09:46.329045 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 15:09:46.329045 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 15:09:46.329045 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: 0b8be0ab53ae48af844bc281dee5f77c Jun 16 15:09:46.329045 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:09:46.329045 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 15:09:46.329045 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance 0fdfccb3-ca19-46af-91ee-db50006827ac could not be found. Jun 16 15:09:46.329045 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': '0fdfccb3-ca19-46af-91ee-db50006827ac'} Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fdfccb3-ca19-46af-91ee-db50006827ac could not be found. Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:09:46.329987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:09:46.331606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:09:46.331606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:09:46.331606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:09:46.331606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:09:46.331606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:09:46.331606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:09:46.331606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:09:46.331606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fdfccb3-ca19-46af-91ee-db50006827ac could not be found. Jun 16 15:09:46.331606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:46.331606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:46.331606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:46.331606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:46.331606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:46.331606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:46.331606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:09:46.331606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:09:46.331606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fdfccb3-ca19-46af-91ee-db50006827ac could not be found. Jun 16 15:09:46.331606 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:46.333059 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-abe36f86-09be-4298-b988-274f065838e0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Returning 404 to user: Instance 0fdfccb3-ca19-46af-91ee-db50006827ac could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:09:46.333059 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-abe36f86-09be-4298-b988-274f065838e0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 404 len: 111 microversion: 2.1 time: 0.030082 Jun 16 15:09:46.333059 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 655/1299] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:46 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:09:46.337767 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-68ea879d-0c37-4af8-97d8-8f339beccebb tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '.version_select at 0x7faab63e9d30>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:46.354881 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-68ea879d-0c37-4af8-97d8-8f339beccebb tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-417679563" status: 202 len: 0 microversion: 2.1 time: 0.021150 Jun 16 15:09:46.355469 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 645/1300] 10.222.0.72 () {58 vars in 1217 bytes} [Thu Jun 16 15:09:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-417679563 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:09:50.752275 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f0204418-8c4b-4e6d-9254-150f7baae034 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:50.753243 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f0204418-8c4b-4e6d-9254-150f7baae034 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:50.760490 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0204418-8c4b-4e6d-9254-150f7baae034 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:50.761089 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0204418-8c4b-4e6d-9254-150f7baae034 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:50.761857 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0204418-8c4b-4e6d-9254-150f7baae034 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:50.762295 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0204418-8c4b-4e6d-9254-150f7baae034 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:50.791339 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f0204418-8c4b-4e6d-9254-150f7baae034 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043051 Jun 16 15:09:50.791887 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 656/1301] 10.222.0.72 () {60 vars in 1342 bytes} [Thu Jun 16 15:09:50 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:50.849493 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b9445fb0-a2c6-42cb-a7ac-ac9f3b9f0335 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:50.850027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b9445fb0-a2c6-42cb-a7ac-ac9f3b9f0335 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:50.855923 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b9445fb0-a2c6-42cb-a7ac-ac9f3b9f0335 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:50.856378 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b9445fb0-a2c6-42cb-a7ac-ac9f3b9f0335 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:50.857178 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b9445fb0-a2c6-42cb-a7ac-ac9f3b9f0335 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:50.857625 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b9445fb0-a2c6-42cb-a7ac-ac9f3b9f0335 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:50.883914 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b9445fb0-a2c6-42cb-a7ac-ac9f3b9f0335 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:09:50.955143 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b9445fb0-a2c6-42cb-a7ac-ac9f3b9f0335 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 204 len: 0 microversion: 2.20 time: 0.110282 Jun 16 15:09:50.955891 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 646/1302] 10.222.0.72 () {60 vars in 1279 bytes} [Thu Jun 16 15:09:50 2022] DELETE /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 15:09:50.964287 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ce500754-4dce-4b44-bca4-c5fdb7c9feb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:50.964937 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ce500754-4dce-4b44-bca4-c5fdb7c9feb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:50.970924 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce500754-4dce-4b44-bca4-c5fdb7c9feb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:50.971375 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce500754-4dce-4b44-bca4-c5fdb7c9feb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:50.972140 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce500754-4dce-4b44-bca4-c5fdb7c9feb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:50.972573 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce500754-4dce-4b44-bca4-c5fdb7c9feb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:51.335706 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ce500754-4dce-4b44-bca4-c5fdb7c9feb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:51.343708 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ce500754-4dce-4b44-bca4-c5fdb7c9feb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:51.345252 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ce500754-4dce-4b44-bca4-c5fdb7c9feb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:51.346409 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ce500754-4dce-4b44-bca4-c5fdb7c9feb9 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.386343 Jun 16 15:09:51.346959 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 657/1303] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:09:50 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:09:52.365149 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f8ea1268-3ad5-473c-b007-eea83a662f8d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:52.365868 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f8ea1268-3ad5-473c-b007-eea83a662f8d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:52.372267 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f8ea1268-3ad5-473c-b007-eea83a662f8d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:52.372711 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f8ea1268-3ad5-473c-b007-eea83a662f8d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:52.373503 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f8ea1268-3ad5-473c-b007-eea83a662f8d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:52.373936 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f8ea1268-3ad5-473c-b007-eea83a662f8d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:52.504187 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f8ea1268-3ad5-473c-b007-eea83a662f8d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:52.512429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f8ea1268-3ad5-473c-b007-eea83a662f8d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:52.513225 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8d69fe21-edaf-420e-8a89-1a8b505623d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:52.513725 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8d69fe21-edaf-420e-8a89-1a8b505623d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:52.514580 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f8ea1268-3ad5-473c-b007-eea83a662f8d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:52.515762 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f8ea1268-3ad5-473c-b007-eea83a662f8d tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.155469 Jun 16 15:09:52.516312 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 647/1304] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:09:52 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:09:52.521876 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8d69fe21-edaf-420e-8a89-1a8b505623d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:52.522339 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8d69fe21-edaf-420e-8a89-1a8b505623d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:52.523076 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8d69fe21-edaf-420e-8a89-1a8b505623d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:52.523503 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8d69fe21-edaf-420e-8a89-1a8b505623d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:52.537903 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-8d69fe21-edaf-420e-8a89-1a8b505623d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] HTTP exception thrown: Instance 0fdfccb3-ca19-46af-91ee-db50006827ac could not be found. Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8d69fe21-edaf-420e-8a89-1a8b505623d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Request method failure captured: Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: DELETE /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac HTTP/1.1 Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0TU2Gjo7bUkrQIinrAEmUizdcavVo4cOx7_e9CBdhqQMOL_HN88fbcSkNjz0fxmjx2YzvDmjFBGY4yiPbtaUHC4qF4lZPrXQHcA8kaogkzbM_Pr4t5ixnvBhbj3OMnQtdL4-hEGTH3GzOC14o5hpUT2K4iK3ilxCwb3lslIqMZDzIU Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 15:09:52.539439 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 15:09:52.541271 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2940b81a86c2401db1aa432d9a0735eb", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:09:52.541271 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:52.541271 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:09:52.541271 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:52.541271 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:09:52.541271 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 15:09:52.541271 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 15:09:52.541271 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: 0b8be0ab53ae48af844bc281dee5f77c Jun 16 15:09:52.541271 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:09:52.541271 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 15:09:52.541271 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance 0fdfccb3-ca19-46af-91ee-db50006827ac could not be found. Jun 16 15:09:52.541271 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': '0fdfccb3-ca19-46af-91ee-db50006827ac'} Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fdfccb3-ca19-46af-91ee-db50006827ac could not be found. Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:09:52.542164 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fdfccb3-ca19-46af-91ee-db50006827ac could not be found. Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fdfccb3-ca19-46af-91ee-db50006827ac could not be found. Jun 16 15:09:52.543643 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:52.545425 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8d69fe21-edaf-420e-8a89-1a8b505623d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Returning 404 to user: Instance 0fdfccb3-ca19-46af-91ee-db50006827ac could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:09:52.545425 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8d69fe21-edaf-420e-8a89-1a8b505623d3 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "DELETE /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 404 len: 111 microversion: 2.1 time: 0.031556 Jun 16 15:09:52.545425 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 658/1305] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:09:52 2022] DELETE /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 15:09:52.551171 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1649d318-de89-41cc-9544-09e45678e4f0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:52.551792 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1649d318-de89-41cc-9544-09e45678e4f0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 0fdfccb3-ca19-46af-91ee-db50006827ac] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:52.557965 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1649d318-de89-41cc-9544-09e45678e4f0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:52.558497 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1649d318-de89-41cc-9544-09e45678e4f0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:52.559276 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1649d318-de89-41cc-9544-09e45678e4f0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:52.559726 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1649d318-de89-41cc-9544-09e45678e4f0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:52.573542 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-1649d318-de89-41cc-9544-09e45678e4f0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] HTTP exception thrown: Instance 0fdfccb3-ca19-46af-91ee-db50006827ac could not be found. Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1649d318-de89-41cc-9544-09e45678e4f0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Request method failure captured: Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac HTTP/1.1 Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TU2Gjo7bUkrQIinrAEmUizdcavVo4cOx7_e9CBdhqQMOL_HN88fbcSkNjz0fxmjx2YzvDmjFBGY4yiPbtaUHC4qF4lZPrXQHcA8kaogkzbM_Pr4t5ixnvBhbj3OMnQtdL4-hEGTH3GzOC14o5hpUT2K4iK3ilxCwb3lslIqMZDzIU Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:09:52.575194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:09:52.576811 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2940b81a86c2401db1aa432d9a0735eb", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:09:52.576811 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:52.576811 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:09:52.576811 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:52.576811 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:09:52.576811 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:09:52.576811 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:09:52.576811 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 0b8be0ab53ae48af844bc281dee5f77c Jun 16 15:09:52.576811 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:09:52.576811 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:09:52.576811 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance 0fdfccb3-ca19-46af-91ee-db50006827ac could not be found. Jun 16 15:09:52.576811 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': '0fdfccb3-ca19-46af-91ee-db50006827ac'} Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fdfccb3-ca19-46af-91ee-db50006827ac could not be found. Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:09:52.577789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:09:52.579198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:09:52.579198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:09:52.579198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:09:52.579198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:09:52.579198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:09:52.579198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:09:52.579198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:09:52.579198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fdfccb3-ca19-46af-91ee-db50006827ac could not be found. Jun 16 15:09:52.579198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:52.579198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:52.579198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:52.579198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:52.579198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:52.579198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:52.579198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:09:52.579198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:09:52.579198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fdfccb3-ca19-46af-91ee-db50006827ac could not be found. Jun 16 15:09:52.579198 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:52.580573 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1649d318-de89-41cc-9544-09e45678e4f0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Returning 404 to user: Instance 0fdfccb3-ca19-46af-91ee-db50006827ac could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:09:52.580573 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1649d318-de89-41cc-9544-09e45678e4f0 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac" status: 404 len: 111 microversion: 2.1 time: 0.029481 Jun 16 15:09:52.580573 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 648/1306] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:52 2022] GET /compute/v2.1/servers/0fdfccb3-ca19-46af-91ee-db50006827ac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:09:53.534428 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-46373993-b128-4007-b640-4a0f9cfedea4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:53.535033 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-46373993-b128-4007-b640-4a0f9cfedea4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:53.541526 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-46373993-b128-4007-b640-4a0f9cfedea4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:53.541961 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-46373993-b128-4007-b640-4a0f9cfedea4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:53.542720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-46373993-b128-4007-b640-4a0f9cfedea4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:53.543157 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-46373993-b128-4007-b640-4a0f9cfedea4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:53.673116 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-46373993-b128-4007-b640-4a0f9cfedea4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:53.681140 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-46373993-b128-4007-b640-4a0f9cfedea4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:53.682644 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-46373993-b128-4007-b640-4a0f9cfedea4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:53.683810 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-46373993-b128-4007-b640-4a0f9cfedea4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.153624 Jun 16 15:09:53.684373 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 659/1307] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:09:53 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:09:53.718445 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0f7bd76b-4bb1-405b-9309-be7df6aaef6b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:53.718976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0f7bd76b-4bb1-405b-9309-be7df6aaef6b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:53.725944 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0f7bd76b-4bb1-405b-9309-be7df6aaef6b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:53.726399 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0f7bd76b-4bb1-405b-9309-be7df6aaef6b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:53.727161 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0f7bd76b-4bb1-405b-9309-be7df6aaef6b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:53.727604 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0f7bd76b-4bb1-405b-9309-be7df6aaef6b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:53.741476 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-0f7bd76b-4bb1-405b-9309-be7df6aaef6b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] HTTP exception thrown: Instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 could not be found. Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0f7bd76b-4bb1-405b-9309-be7df6aaef6b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Request method failure captured: Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: DELETE /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 HTTP/1.1 Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TU2Gjo7bUkrQIinrAEmUizdcavVo4cOx7_e9CBdhqQMOL_HN88fbcSkNjz0fxmjx2YzvDmjFBGY4yiPbtaUHC4qF4lZPrXQHcA8kaogkzbM_Pr4t5ixnvBhbj3OMnQtdL4-hEGTH3GzOC14o5hpUT2K4iK3ilxCwb3lslIqMZDzIU Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:09:53.743288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:09:53.750579 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2940b81a86c2401db1aa432d9a0735eb", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:09:53.750579 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:53.750579 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:09:53.750579 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:53.750579 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:09:53.750579 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:09:53.750579 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:09:53.750579 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 0b8be0ab53ae48af844bc281dee5f77c Jun 16 15:09:53.750579 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:09:53.750579 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:09:53.750579 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 could not be found. Jun 16 15:09:53.750579 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': '8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8'} Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 could not be found. Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:09:53.753102 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 could not be found. Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 could not be found. Jun 16 15:09:53.756202 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.757949 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0f7bd76b-4bb1-405b-9309-be7df6aaef6b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Returning 404 to user: Instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:09:53.757949 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0f7bd76b-4bb1-405b-9309-be7df6aaef6b tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "DELETE /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 404 len: 111 microversion: 2.1 time: 0.030576 Jun 16 15:09:53.757949 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 649/1308] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:09:53 2022] DELETE /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:09:53.758382 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-674d7299-15b8-4c52-b131-797447b02f10 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:53.758382 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-674d7299-15b8-4c52-b131-797447b02f10 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:53.763421 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-674d7299-15b8-4c52-b131-797447b02f10 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:53.763557 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-674d7299-15b8-4c52-b131-797447b02f10 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:53.764237 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-674d7299-15b8-4c52-b131-797447b02f10 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:53.764677 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-674d7299-15b8-4c52-b131-797447b02f10 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:53.783584 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-674d7299-15b8-4c52-b131-797447b02f10 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] HTTP exception thrown: Instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 could not be found. Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-674d7299-15b8-4c52-b131-797447b02f10 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Request method failure captured: Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 HTTP/1.1 Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0TU2Gjo7bUkrQIinrAEmUizdcavVo4cOx7_e9CBdhqQMOL_HN88fbcSkNjz0fxmjx2YzvDmjFBGY4yiPbtaUHC4qF4lZPrXQHcA8kaogkzbM_Pr4t5ixnvBhbj3OMnQtdL4-hEGTH3GzOC14o5hpUT2K4iK3ilxCwb3lslIqMZDzIU Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 15:09:53.785192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 15:09:53.786860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2940b81a86c2401db1aa432d9a0735eb", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:09:53.786860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:53.786860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:09:53.786860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:53.786860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:09:53.786860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 15:09:53.786860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 15:09:53.786860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: 0b8be0ab53ae48af844bc281dee5f77c Jun 16 15:09:53.786860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:09:53.786860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 15:09:53.786860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 could not be found. Jun 16 15:09:53.786860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': '8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8'} Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 could not be found. Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:09:53.787763 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:09:53.789288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:09:53.789288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:09:53.789288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:09:53.789288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:09:53.789288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:09:53.789288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:09:53.789288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:09:53.789288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 could not be found. Jun 16 15:09:53.789288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.789288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:53.789288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.789288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:53.789288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:53.789288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:53.789288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:09:53.789288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:09:53.789288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 could not be found. Jun 16 15:09:53.789288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.790682 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-674d7299-15b8-4c52-b131-797447b02f10 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Returning 404 to user: Instance 8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:09:53.790682 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-674d7299-15b8-4c52-b131-797447b02f10 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8" status: 404 len: 111 microversion: 2.1 time: 0.035400 Jun 16 15:09:53.790682 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 660/1309] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:53 2022] GET /compute/v2.1/servers/8ec7b98c-05a8-495b-ad3f-b5cfbd73a8d8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 15:09:53.796358 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4dbc18e9-cd1b-46c2-a21d-df550be8acaa tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:53.796892 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4dbc18e9-cd1b-46c2-a21d-df550be8acaa tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:53.804405 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4dbc18e9-cd1b-46c2-a21d-df550be8acaa tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:53.805157 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4dbc18e9-cd1b-46c2-a21d-df550be8acaa tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:53.805823 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4dbc18e9-cd1b-46c2-a21d-df550be8acaa tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:53.806266 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4dbc18e9-cd1b-46c2-a21d-df550be8acaa tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:53.825096 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-4dbc18e9-cd1b-46c2-a21d-df550be8acaa tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] HTTP exception thrown: Instance a6a310ce-a575-4379-9390-2b4ad718e3ed could not be found. Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4dbc18e9-cd1b-46c2-a21d-df550be8acaa tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Request method failure captured: Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: DELETE /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed HTTP/1.1 Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TU2Gjo7bUkrQIinrAEmUizdcavVo4cOx7_e9CBdhqQMOL_HN88fbcSkNjz0fxmjx2YzvDmjFBGY4yiPbtaUHC4qF4lZPrXQHcA8kaogkzbM_Pr4t5ixnvBhbj3OMnQtdL4-hEGTH3GzOC14o5hpUT2K4iK3ilxCwb3lslIqMZDzIU Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:09:53.826674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:09:53.828303 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2940b81a86c2401db1aa432d9a0735eb", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:09:53.828303 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:53.828303 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:09:53.828303 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:53.828303 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:09:53.828303 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:09:53.828303 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:09:53.828303 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 0b8be0ab53ae48af844bc281dee5f77c Jun 16 15:09:53.828303 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:09:53.828303 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:09:53.828303 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance a6a310ce-a575-4379-9390-2b4ad718e3ed could not be found. Jun 16 15:09:53.828303 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': 'a6a310ce-a575-4379-9390-2b4ad718e3ed'} Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6a310ce-a575-4379-9390-2b4ad718e3ed could not be found. Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:09:53.829194 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6a310ce-a575-4379-9390-2b4ad718e3ed could not be found. Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6a310ce-a575-4379-9390-2b4ad718e3ed could not be found. Jun 16 15:09:53.830827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.832951 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4dbc18e9-cd1b-46c2-a21d-df550be8acaa tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Returning 404 to user: Instance a6a310ce-a575-4379-9390-2b4ad718e3ed could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:09:53.832951 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4dbc18e9-cd1b-46c2-a21d-df550be8acaa tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "DELETE /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 404 len: 111 microversion: 2.1 time: 0.036747 Jun 16 15:09:53.832951 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 650/1310] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:09:53 2022] DELETE /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:09:53.837314 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-77556180-56c8-4871-9505-5ef1d829ffc6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:53.837928 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-77556180-56c8-4871-9505-5ef1d829ffc6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: a6a310ce-a575-4379-9390-2b4ad718e3ed] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:53.843994 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-77556180-56c8-4871-9505-5ef1d829ffc6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:53.844438 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-77556180-56c8-4871-9505-5ef1d829ffc6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:53.845237 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-77556180-56c8-4871-9505-5ef1d829ffc6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:53.845674 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-77556180-56c8-4871-9505-5ef1d829ffc6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:53.858990 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-77556180-56c8-4871-9505-5ef1d829ffc6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] HTTP exception thrown: Instance a6a310ce-a575-4379-9390-2b4ad718e3ed could not be found. Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-77556180-56c8-4871-9505-5ef1d829ffc6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Request method failure captured: Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed HTTP/1.1 Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0TU2Gjo7bUkrQIinrAEmUizdcavVo4cOx7_e9CBdhqQMOL_HN88fbcSkNjz0fxmjx2YzvDmjFBGY4yiPbtaUHC4qF4lZPrXQHcA8kaogkzbM_Pr4t5ixnvBhbj3OMnQtdL4-hEGTH3GzOC14o5hpUT2K4iK3ilxCwb3lslIqMZDzIU Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 15:09:53.860518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 15:09:53.862161 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2940b81a86c2401db1aa432d9a0735eb", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:09:53.862161 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:53.862161 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:09:53.862161 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:53.862161 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:09:53.862161 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 15:09:53.862161 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 15:09:53.862161 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: 0b8be0ab53ae48af844bc281dee5f77c Jun 16 15:09:53.862161 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:09:53.862161 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 15:09:53.862161 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance a6a310ce-a575-4379-9390-2b4ad718e3ed could not be found. Jun 16 15:09:53.862161 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': 'a6a310ce-a575-4379-9390-2b4ad718e3ed'} Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6a310ce-a575-4379-9390-2b4ad718e3ed could not be found. Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:09:53.863624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:09:53.864916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:09:53.864916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:09:53.864916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:09:53.864916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:09:53.864916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:09:53.864916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:09:53.864916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:09:53.864916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6a310ce-a575-4379-9390-2b4ad718e3ed could not be found. Jun 16 15:09:53.864916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.864916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:53.864916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.864916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:53.864916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:53.864916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:53.864916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:09:53.864916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:09:53.864916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6a310ce-a575-4379-9390-2b4ad718e3ed could not be found. Jun 16 15:09:53.864916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:53.866731 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-77556180-56c8-4871-9505-5ef1d829ffc6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Returning 404 to user: Instance a6a310ce-a575-4379-9390-2b4ad718e3ed could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:09:53.866731 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-77556180-56c8-4871-9505-5ef1d829ffc6 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed" status: 404 len: 111 microversion: 2.1 time: 0.028406 Jun 16 15:09:53.866731 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 661/1311] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:53 2022] GET /compute/v2.1/servers/a6a310ce-a575-4379-9390-2b4ad718e3ed => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:09:54.216245 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f3a37647-ac2b-4214-9fe6-c43d3022a544 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:54.216914 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f3a37647-ac2b-4214-9fe6-c43d3022a544 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:54.218347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-065f1a0a-753e-4976-9873-aa6cad178193 req-5d73963d-0d1a-46f2-963a-4aa65a17983e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "396d3e73-5c6a-4889-84e6-7a440d744018", "tag": "4dcaa0bd-2a2c-4ab0-8ae1-a7aca82c5393"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:09:54.223547 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f3a37647-ac2b-4214-9fe6-c43d3022a544 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:54.224108 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f3a37647-ac2b-4214-9fe6-c43d3022a544 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:54.225041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f3a37647-ac2b-4214-9fe6-c43d3022a544 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:54.225725 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f3a37647-ac2b-4214-9fe6-c43d3022a544 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:54.226742 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-065f1a0a-753e-4976-9873-aa6cad178193 req-5d73963d-0d1a-46f2-963a-4aa65a17983e service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:54.227192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-065f1a0a-753e-4976-9873-aa6cad178193 req-5d73963d-0d1a-46f2-963a-4aa65a17983e service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:54.239069 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-065f1a0a-753e-4976-9873-aa6cad178193 req-5d73963d-0d1a-46f2-963a-4aa65a17983e service nova] Creating event network-changed:4dcaa0bd-2a2c-4ab0-8ae1-a7aca82c5393 for instance 396d3e73-5c6a-4889-84e6-7a440d744018 on hv-cinder-83716 Jun 16 15:09:54.244802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-065f1a0a-753e-4976-9873-aa6cad178193 req-5d73963d-0d1a-46f2-963a-4aa65a17983e service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030022 Jun 16 15:09:54.245736 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 662/1312] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:54.253592 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f3a37647-ac2b-4214-9fe6-c43d3022a544 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:09:54.332825 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f3a37647-ac2b-4214-9fe6-c43d3022a544 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "DELETE /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 204 len: 0 microversion: 2.1 time: 0.120363 Jun 16 15:09:54.333436 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 651/1313] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:09:54 2022] DELETE /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:09:54.342286 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0c811abd-f9e6-4e3e-84c5-c4e5e9103773 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:54.342975 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0c811abd-f9e6-4e3e-84c5-c4e5e9103773 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:54.349672 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c811abd-f9e6-4e3e-84c5-c4e5e9103773 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:54.350324 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c811abd-f9e6-4e3e-84c5-c4e5e9103773 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:54.351124 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c811abd-f9e6-4e3e-84c5-c4e5e9103773 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:54.351510 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c811abd-f9e6-4e3e-84c5-c4e5e9103773 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:54.491416 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0c811abd-f9e6-4e3e-84c5-c4e5e9103773 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:54.498979 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0c811abd-f9e6-4e3e-84c5-c4e5e9103773 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1577 microversion: 2.1 time: 0.160926 Jun 16 15:09:54.499540 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 663/1314] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:54 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:54.703076 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-85d62e24-459e-4a7f-894c-981248494cf4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:54.704072 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-85d62e24-459e-4a7f-894c-981248494cf4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:54.710859 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85d62e24-459e-4a7f-894c-981248494cf4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:54.711380 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85d62e24-459e-4a7f-894c-981248494cf4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:54.712156 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85d62e24-459e-4a7f-894c-981248494cf4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:54.712626 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85d62e24-459e-4a7f-894c-981248494cf4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:54.715431 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:54.847370 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-85d62e24-459e-4a7f-894c-981248494cf4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:54.859598 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-85d62e24-459e-4a7f-894c-981248494cf4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:54.861113 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-85d62e24-459e-4a7f-894c-981248494cf4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:54.862273 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-85d62e24-459e-4a7f-894c-981248494cf4 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.163716 Jun 16 15:09:54.862809 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 652/1315] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:09:54 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:09:55.515943 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-47c266fb-556c-4bbd-bfbb-31e8e01ce8c1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:55.516559 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-47c266fb-556c-4bbd-bfbb-31e8e01ce8c1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:55.523551 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-47c266fb-556c-4bbd-bfbb-31e8e01ce8c1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:55.524003 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-47c266fb-556c-4bbd-bfbb-31e8e01ce8c1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:55.524771 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-47c266fb-556c-4bbd-bfbb-31e8e01ce8c1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:55.525238 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-47c266fb-556c-4bbd-bfbb-31e8e01ce8c1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:55.529338 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:09:55.655513 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-47c266fb-556c-4bbd-bfbb-31e8e01ce8c1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:55.663939 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-47c266fb-556c-4bbd-bfbb-31e8e01ce8c1 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1577 microversion: 2.1 time: 0.151911 Jun 16 15:09:55.664501 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 664/1316] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:55 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:55.881252 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-943b42b4-2eae-4502-8a69-c9ff46df47cf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:55.881775 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-943b42b4-2eae-4502-8a69-c9ff46df47cf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:55.888718 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-943b42b4-2eae-4502-8a69-c9ff46df47cf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:55.889219 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-943b42b4-2eae-4502-8a69-c9ff46df47cf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:55.889989 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-943b42b4-2eae-4502-8a69-c9ff46df47cf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:55.890432 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-943b42b4-2eae-4502-8a69-c9ff46df47cf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:56.025431 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-943b42b4-2eae-4502-8a69-c9ff46df47cf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:56.033783 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-943b42b4-2eae-4502-8a69-c9ff46df47cf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:56.035297 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-943b42b4-2eae-4502-8a69-c9ff46df47cf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:56.036468 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-943b42b4-2eae-4502-8a69-c9ff46df47cf tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.159819 Jun 16 15:09:56.037243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 653/1317] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:09:55 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:09:56.681713 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5cbb7935-ad39-4b22-944d-efd4d4266bde tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:56.682331 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5cbb7935-ad39-4b22-944d-efd4d4266bde tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:56.689015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5cbb7935-ad39-4b22-944d-efd4d4266bde tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:56.689471 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5cbb7935-ad39-4b22-944d-efd4d4266bde tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:56.690237 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5cbb7935-ad39-4b22-944d-efd4d4266bde tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:56.690675 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5cbb7935-ad39-4b22-944d-efd4d4266bde tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:56.821588 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5cbb7935-ad39-4b22-944d-efd4d4266bde tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:56.829245 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5cbb7935-ad39-4b22-944d-efd4d4266bde tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1577 microversion: 2.1 time: 0.152054 Jun 16 15:09:56.829817 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 665/1318] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:56 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:57.053450 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7b9919b1-abf9-4a29-9dea-26b9fab987dd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:57.054090 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7b9919b1-abf9-4a29-9dea-26b9fab987dd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:57.060555 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b9919b1-abf9-4a29-9dea-26b9fab987dd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:57.061037 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b9919b1-abf9-4a29-9dea-26b9fab987dd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:57.061789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b9919b1-abf9-4a29-9dea-26b9fab987dd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:57.062233 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b9919b1-abf9-4a29-9dea-26b9fab987dd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:57.198706 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7b9919b1-abf9-4a29-9dea-26b9fab987dd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:57.206618 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7b9919b1-abf9-4a29-9dea-26b9fab987dd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:57.208120 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7b9919b1-abf9-4a29-9dea-26b9fab987dd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:57.209808 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7b9919b1-abf9-4a29-9dea-26b9fab987dd tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.160200 Jun 16 15:09:57.210363 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 654/1319] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:09:57 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:09:57.846506 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0c589c20-1883-4201-a977-ddb73d18fe85 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:57.847115 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0c589c20-1883-4201-a977-ddb73d18fe85 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:57.853698 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c589c20-1883-4201-a977-ddb73d18fe85 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:57.854151 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c589c20-1883-4201-a977-ddb73d18fe85 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:57.854911 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c589c20-1883-4201-a977-ddb73d18fe85 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:57.855347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c589c20-1883-4201-a977-ddb73d18fe85 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:57.992203 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0c589c20-1883-4201-a977-ddb73d18fe85 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:58.000364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0c589c20-1883-4201-a977-ddb73d18fe85 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1577 microversion: 2.1 time: 0.157760 Jun 16 15:09:58.001266 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 666/1320] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:57 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:58.064726 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-4325a919-f16b-45e3-b09a-a80a15054171 req-752dcdc2-48e7-495d-81a4-d298f46a779a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53e3fc3-e13f-4352-ad2f-7babd83b19e3", "name": "network-vif-unplugged", "status": "completed", "tag": "2fd6981b-720b-4e5e-a50b-00f468402a5f"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:09:58.075114 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-4325a919-f16b-45e3-b09a-a80a15054171 req-752dcdc2-48e7-495d-81a4-d298f46a779a service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:58.075766 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-4325a919-f16b-45e3-b09a-a80a15054171 req-752dcdc2-48e7-495d-81a4-d298f46a779a service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:58.087188 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-4325a919-f16b-45e3-b09a-a80a15054171 req-752dcdc2-48e7-495d-81a4-d298f46a779a service nova] Creating event network-vif-unplugged:2fd6981b-720b-4e5e-a50b-00f468402a5f for instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 on hv-cinder-83716 Jun 16 15:09:58.092372 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-4325a919-f16b-45e3-b09a-a80a15054171 req-752dcdc2-48e7-495d-81a4-d298f46a779a service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030962 Jun 16 15:09:58.093003 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 655/1321] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:58.228130 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8fa17937-02b7-4728-a124-62e82bf698dc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:58.228741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8fa17937-02b7-4728-a124-62e82bf698dc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:58.234782 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8fa17937-02b7-4728-a124-62e82bf698dc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:58.235238 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8fa17937-02b7-4728-a124-62e82bf698dc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:58.235997 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8fa17937-02b7-4728-a124-62e82bf698dc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:58.236426 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8fa17937-02b7-4728-a124-62e82bf698dc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:58.367102 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8fa17937-02b7-4728-a124-62e82bf698dc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:58.375899 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8fa17937-02b7-4728-a124-62e82bf698dc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:58.377457 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8fa17937-02b7-4728-a124-62e82bf698dc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:58.379639 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8fa17937-02b7-4728-a124-62e82bf698dc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1721 microversion: 2.20 time: 0.155877 Jun 16 15:09:58.380678 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 667/1322] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:09:58 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:09:58.675521 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-2a151b44-ce09-46b2-849d-07951c5227ca req-540698e0-7c55-40bb-8129-5cd1114f2f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53e3fc3-e13f-4352-ad2f-7babd83b19e3", "name": "network-vif-deleted", "tag": "2fd6981b-720b-4e5e-a50b-00f468402a5f"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:09:58.683785 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-2a151b44-ce09-46b2-849d-07951c5227ca req-540698e0-7c55-40bb-8129-5cd1114f2f79 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:58.684310 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-2a151b44-ce09-46b2-849d-07951c5227ca req-540698e0-7c55-40bb-8129-5cd1114f2f79 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:58.695207 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-2a151b44-ce09-46b2-849d-07951c5227ca req-540698e0-7c55-40bb-8129-5cd1114f2f79 service nova] Creating event network-vif-deleted:2fd6981b-720b-4e5e-a50b-00f468402a5f for instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 on hv-cinder-83716 Jun 16 15:09:58.700094 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-2a151b44-ce09-46b2-849d-07951c5227ca req-540698e0-7c55-40bb-8129-5cd1114f2f79 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028772 Jun 16 15:09:58.700678 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 656/1323] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:09:59.018517 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3fc3bb26-f81a-4087-b0b9-04294b0b8e3e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:59.019293 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3fc3bb26-f81a-4087-b0b9-04294b0b8e3e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:59.027027 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3fc3bb26-f81a-4087-b0b9-04294b0b8e3e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:59.028061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3fc3bb26-f81a-4087-b0b9-04294b0b8e3e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:59.028991 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3fc3bb26-f81a-4087-b0b9-04294b0b8e3e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:59.029529 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3fc3bb26-f81a-4087-b0b9-04294b0b8e3e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:59.180747 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3fc3bb26-f81a-4087-b0b9-04294b0b8e3e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:59.190361 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3fc3bb26-f81a-4087-b0b9-04294b0b8e3e tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1577 microversion: 2.1 time: 0.175729 Jun 16 15:09:59.200966 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 668/1324] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:59 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:09:59.221290 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7b323d94-d3a2-464f-bc06-6d48227c7798 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:59.222054 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7b323d94-d3a2-464f-bc06-6d48227c7798 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:59.230417 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b323d94-d3a2-464f-bc06-6d48227c7798 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:59.231352 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b323d94-d3a2-464f-bc06-6d48227c7798 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:59.232167 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b323d94-d3a2-464f-bc06-6d48227c7798 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:59.232639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b323d94-d3a2-464f-bc06-6d48227c7798 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:59.246724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-7b323d94-d3a2-464f-bc06-6d48227c7798 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] HTTP exception thrown: Instance 133e2287-518a-4c4e-bb51-8790ed7647a7 could not be found. Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7b323d94-d3a2-464f-bc06-6d48227c7798 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Request method failure captured: Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: DELETE /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 HTTP/1.1 Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TU2Gjo7bUkrQIinrAEmUizdcavVo4cOx7_e9CBdhqQMOL_HN88fbcSkNjz0fxmjx2YzvDmjFBGY4yiPbtaUHC4qF4lZPrXQHcA8kaogkzbM_Pr4t5ixnvBhbj3OMnQtdL4-hEGTH3GzOC14o5hpUT2K4iK3ilxCwb3lslIqMZDzIU Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:09:59.248463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:09:59.250169 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2940b81a86c2401db1aa432d9a0735eb", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:09:59.250169 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:59.250169 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:09:59.250169 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:59.250169 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:09:59.250169 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:09:59.250169 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:09:59.250169 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 0b8be0ab53ae48af844bc281dee5f77c Jun 16 15:09:59.250169 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:09:59.250169 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:09:59.250169 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance 133e2287-518a-4c4e-bb51-8790ed7647a7 could not be found. Jun 16 15:09:59.250169 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': '133e2287-518a-4c4e-bb51-8790ed7647a7'} Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 133e2287-518a-4c4e-bb51-8790ed7647a7 could not be found. Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:09:59.251043 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 133e2287-518a-4c4e-bb51-8790ed7647a7 could not be found. Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 133e2287-518a-4c4e-bb51-8790ed7647a7 could not be found. Jun 16 15:09:59.252610 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:09:59.254147 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7b323d94-d3a2-464f-bc06-6d48227c7798 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Returning 404 to user: Instance 133e2287-518a-4c4e-bb51-8790ed7647a7 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:09:59.254147 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7b323d94-d3a2-464f-bc06-6d48227c7798 tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "DELETE /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 404 len: 111 microversion: 2.1 time: 0.035973 Jun 16 15:09:59.254147 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 657/1325] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:09:59 2022] DELETE /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:09:59.259293 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d104ba3d-f1d3-44bd-89df-62b4e837f9dc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:59.260729 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d104ba3d-f1d3-44bd-89df-62b4e837f9dc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] [instance: 133e2287-518a-4c4e-bb51-8790ed7647a7] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:59.268877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d104ba3d-f1d3-44bd-89df-62b4e837f9dc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:59.269413 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d104ba3d-f1d3-44bd-89df-62b4e837f9dc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:59.270196 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d104ba3d-f1d3-44bd-89df-62b4e837f9dc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:59.270654 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d104ba3d-f1d3-44bd-89df-62b4e837f9dc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:59.285900 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-d104ba3d-f1d3-44bd-89df-62b4e837f9dc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] HTTP exception thrown: Instance 133e2287-518a-4c4e-bb51-8790ed7647a7 could not be found. Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d104ba3d-f1d3-44bd-89df-62b4e837f9dc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Request method failure captured: Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 HTTP/1.1 Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0TU2Gjo7bUkrQIinrAEmUizdcavVo4cOx7_e9CBdhqQMOL_HN88fbcSkNjz0fxmjx2YzvDmjFBGY4yiPbtaUHC4qF4lZPrXQHcA8kaogkzbM_Pr4t5ixnvBhbj3OMnQtdL4-hEGTH3GzOC14o5hpUT2K4iK3ilxCwb3lslIqMZDzIU Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 15:09:59.288805 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 15:09:59.290523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2940b81a86c2401db1aa432d9a0735eb", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2940b81a86c2401db1aa432d9a0735eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:09:59.290523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:59.290523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 2940b81a86c2401db1aa432d9a0735eb Jun 16 15:09:59.290523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-54694543 Jun 16 15:09:59.290523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:09:59.290523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 15:09:59.290523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 15:09:59.290523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: 0b8be0ab53ae48af844bc281dee5f77c Jun 16 15:09:59.290523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeNegativeTest-54694543-project Jun 16 15:09:59.290523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 15:09:59.290523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance 133e2287-518a-4c4e-bb51-8790ed7647a7 could not be found. Jun 16 15:09:59.290523 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': '133e2287-518a-4c4e-bb51-8790ed7647a7'} Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 133e2287-518a-4c4e-bb51-8790ed7647a7 could not be found. Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:09:59.291463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:09:59.292957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:09:59.292957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:09:59.292957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:09:59.292957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:09:59.292957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:09:59.292957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:09:59.292957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:09:59.292957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 133e2287-518a-4c4e-bb51-8790ed7647a7 could not be found. Jun 16 15:09:59.292957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:59.292957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:09:59.292957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:59.292957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:09:59.292957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:09:59.292957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:09:59.292957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:09:59.292957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:09:59.292957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 133e2287-518a-4c4e-bb51-8790ed7647a7 could not be found. Jun 16 15:09:59.292957 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:09:59.294349 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d104ba3d-f1d3-44bd-89df-62b4e837f9dc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] Returning 404 to user: Instance 133e2287-518a-4c4e-bb51-8790ed7647a7 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:09:59.294349 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d104ba3d-f1d3-44bd-89df-62b4e837f9dc tempest-AttachVolumeNegativeTest-54694543 tempest-AttachVolumeNegativeTest-54694543-project] 10.222.0.72 "GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7" status: 404 len: 111 microversion: 2.1 time: 0.035100 Jun 16 15:09:59.294349 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 669/1326] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:09:59 2022] GET /compute/v2.1/servers/133e2287-518a-4c4e-bb51-8790ed7647a7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:09:59.410733 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2cfd2f02-db91-4f62-b2db-d5516894c97e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:09:59.413329 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2cfd2f02-db91-4f62-b2db-d5516894c97e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:09:59.428470 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2cfd2f02-db91-4f62-b2db-d5516894c97e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:59.431221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2cfd2f02-db91-4f62-b2db-d5516894c97e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:59.433243 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2cfd2f02-db91-4f62-b2db-d5516894c97e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:59.434248 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2cfd2f02-db91-4f62-b2db-d5516894c97e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:59.476044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2cfd2f02-db91-4f62-b2db-d5516894c97e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:09:59.476523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2cfd2f02-db91-4f62-b2db-d5516894c97e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:09:59.477017 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-2cfd2f02-db91-4f62-b2db-d5516894c97e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lazy-loading 'fault' on Instance uuid b53e3fc3-e13f-4352-ad2f-7babd83b19e3 {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:09:59.534644 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2cfd2f02-db91-4f62-b2db-d5516894c97e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:59.543867 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2cfd2f02-db91-4f62-b2db-d5516894c97e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:59.545763 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2cfd2f02-db91-4f62-b2db-d5516894c97e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ba40bcf173404e6c8b17d311b65bf780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a4c67a42f8a405d84d4697a45e962ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:09:59.546997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2cfd2f02-db91-4f62-b2db-d5516894c97e tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 200 len: 1370 microversion: 2.20 time: 0.153082 Jun 16 15:09:59.547517 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 658/1327] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:09:59 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 15:10:00.207837 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f57c81cb-7244-491d-8e2f-16465b52dee8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:00.208532 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f57c81cb-7244-491d-8e2f-16465b52dee8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:10:00.211475 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:00.222737 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f57c81cb-7244-491d-8e2f-16465b52dee8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:00.223312 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f57c81cb-7244-491d-8e2f-16465b52dee8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:00.224199 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f57c81cb-7244-491d-8e2f-16465b52dee8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:00.224796 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f57c81cb-7244-491d-8e2f-16465b52dee8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:00.417094 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f57c81cb-7244-491d-8e2f-16465b52dee8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:10:00.425839 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f57c81cb-7244-491d-8e2f-16465b52dee8 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1577 microversion: 2.1 time: 0.221794 Jun 16 15:10:00.426649 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 670/1328] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:10:00 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1577 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:10:00.565819 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8521b9dc-4bea-435a-a1af-3792eecae61c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:00.566807 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8521b9dc-4bea-435a-a1af-3792eecae61c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:10:00.575023 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:10:00.579593 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8521b9dc-4bea-435a-a1af-3792eecae61c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:00.580284 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8521b9dc-4bea-435a-a1af-3792eecae61c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:00.581240 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8521b9dc-4bea-435a-a1af-3792eecae61c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:00.581833 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8521b9dc-4bea-435a-a1af-3792eecae61c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:00.620970 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-8521b9dc-4bea-435a-a1af-3792eecae61c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] HTTP exception thrown: Instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 could not be found. Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8521b9dc-4bea-435a-a1af-3792eecae61c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Request method failure captured: Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 HTTP/1.1 Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TMjpgChMWBltqPqlOc2QLsqFboHlFg7Zhv6oU8m-3VLra0wCtdBtTj_z-1OqG7sk_8iOEaxtlGIalQr-G6Bz9vT5IwYPuKye4Llr6wMS6vkPTzMQ4Dq1iDN_uiO6bNTWhTo8q3fke8bdPNcKKH6s83IDG0IfsBVY-RvsFLarne2Lc Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 2a4c67a42f8a405d84d4697a45e962ff Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1860873197 Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:10:00.622557 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:10:00.624070 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2a4c67a42f8a405d84d4697a45e962ff", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a4c67a42f8a405d84d4697a45e962ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a4c67a42f8a405d84d4697a45e962ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2a4c67a42f8a405d84d4697a45e962ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:10:00.624070 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1860873197 Jun 16 15:10:00.624070 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 2a4c67a42f8a405d84d4697a45e962ff Jun 16 15:10:00.624070 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1860873197 Jun 16 15:10:00.624070 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeShelveTestJSON-1860873197-project Jun 16 15:10:00.624070 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:10:00.624070 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:10:00.624070 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: ba40bcf173404e6c8b17d311b65bf780 Jun 16 15:10:00.624070 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1860873197-project Jun 16 15:10:00.624070 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:10:00.624070 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 could not be found. Jun 16 15:10:00.624070 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': 'b53e3fc3-e13f-4352-ad2f-7babd83b19e3'} Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 could not be found. Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:10:00.624976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:10:00.626221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:10:00.626221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:10:00.626221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:10:00.626221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:10:00.626221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:10:00.626221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:10:00.626221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:10:00.626221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 could not be found. Jun 16 15:10:00.626221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:00.626221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:00.626221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:00.626221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:00.626221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:00.626221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:00.626221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:10:00.626221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:10:00.626221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 could not be found. Jun 16 15:10:00.626221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:00.627348 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8521b9dc-4bea-435a-a1af-3792eecae61c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Returning 404 to user: Instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:10:00.627348 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8521b9dc-4bea-435a-a1af-3792eecae61c tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 404 len: 111 microversion: 2.20 time: 0.062123 Jun 16 15:10:00.627348 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 659/1329] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:10:00 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 15:10:00.633418 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-14528b94-6cdd-42b4-a6c2-e217a8c0d8dc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '.version_select at 0x7faaba9bca60>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:00.663876 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-14528b94-6cdd-42b4-a6c2-e217a8c0d8dc tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-996339506" status: 204 len: 0 microversion: 2.20 time: 0.034283 Jun 16 15:10:00.664745 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 671/1330] 10.222.0.72 () {60 vars in 1258 bytes} [Thu Jun 16 15:10:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-996339506 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 15:10:01.167113 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-32b8c165-9169-43f8-92be-bb6edb8f219b req-bec2e6af-fcfe-4756-899d-5a7d2fd83a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "396d3e73-5c6a-4889-84e6-7a440d744018", "name": "network-vif-deleted", "tag": "4dcaa0bd-2a2c-4ab0-8ae1-a7aca82c5393"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:10:01.177125 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-32b8c165-9169-43f8-92be-bb6edb8f219b req-bec2e6af-fcfe-4756-899d-5a7d2fd83a4b service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:01.178033 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-32b8c165-9169-43f8-92be-bb6edb8f219b req-bec2e6af-fcfe-4756-899d-5a7d2fd83a4b service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:01.195604 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-32b8c165-9169-43f8-92be-bb6edb8f219b req-bec2e6af-fcfe-4756-899d-5a7d2fd83a4b service nova] Creating event network-vif-deleted:4dcaa0bd-2a2c-4ab0-8ae1-a7aca82c5393 for instance 396d3e73-5c6a-4889-84e6-7a440d744018 on hv-cinder-83716 Jun 16 15:10:01.202677 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-32b8c165-9169-43f8-92be-bb6edb8f219b req-bec2e6af-fcfe-4756-899d-5a7d2fd83a4b service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044216 Jun 16 15:10:01.204727 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 660/1331] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:10:01.443599 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8014db7d-7d3b-4ad0-9462-2795033f2824 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:01.444387 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8014db7d-7d3b-4ad0-9462-2795033f2824 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:10:01.455269 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8014db7d-7d3b-4ad0-9462-2795033f2824 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:01.455760 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8014db7d-7d3b-4ad0-9462-2795033f2824 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:01.456949 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8014db7d-7d3b-4ad0-9462-2795033f2824 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:01.457617 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8014db7d-7d3b-4ad0-9462-2795033f2824 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:01.566579 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8014db7d-7d3b-4ad0-9462-2795033f2824 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:10:01.581396 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8014db7d-7d3b-4ad0-9462-2795033f2824 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 200 len: 1226 microversion: 2.1 time: 0.138732 Jun 16 15:10:01.582470 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 672/1332] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:10:01 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 1226 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:10:02.600924 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-15415845-df1c-42a0-aa83-1b00f13dbf0f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:02.601570 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-15415845-df1c-42a0-aa83-1b00f13dbf0f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 396d3e73-5c6a-4889-84e6-7a440d744018] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:10:02.609892 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-15415845-df1c-42a0-aa83-1b00f13dbf0f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:02.610498 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-15415845-df1c-42a0-aa83-1b00f13dbf0f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:02.611706 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-15415845-df1c-42a0-aa83-1b00f13dbf0f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:02.612089 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-15415845-df1c-42a0-aa83-1b00f13dbf0f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:02.626861 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-15415845-df1c-42a0-aa83-1b00f13dbf0f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] HTTP exception thrown: Instance 396d3e73-5c6a-4889-84e6-7a440d744018 could not be found. Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-15415845-df1c-42a0-aa83-1b00f13dbf0f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Request method failure captured: Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 HTTP/1.1 Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0VkLo99pEkQDuVjNTisJO2-sG7oVfv7DO08x8fqkx6EcNLLXf80_Hwjc01BE91RTfWmiZQQw1LJU0dTSoF8QgEcvi8VVSaDG7nlQTX7LVqf7oo8X0Fav6HUZko0kB1UBk7hD1FmWT7RPFUB0gIxy-F0bslaVdPohd5b8kzo1NfX-js Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 05223500b4a142c7a77c2de010541b84 Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-TestVolumeBootPattern-2072272021 Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:10:02.628523 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:10:02.629984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_05223500b4a142c7a77c2de010541b84", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/05223500b4a142c7a77c2de010541b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/05223500b4a142c7a77c2de010541b84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/05223500b4a142c7a77c2de010541b84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:10:02.629984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-TestVolumeBootPattern-2072272021 Jun 16 15:10:02.629984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 05223500b4a142c7a77c2de010541b84 Jun 16 15:10:02.629984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-TestVolumeBootPattern-2072272021 Jun 16 15:10:02.629984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-TestVolumeBootPattern-2072272021-project Jun 16 15:10:02.629984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:10:02.629984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:10:02.629984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 9d977f609537476daa8fe8adbab9ff9c Jun 16 15:10:02.629984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-TestVolumeBootPattern-2072272021-project Jun 16 15:10:02.629984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:10:02.629984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance 396d3e73-5c6a-4889-84e6-7a440d744018 could not be found. Jun 16 15:10:02.629984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': '396d3e73-5c6a-4889-84e6-7a440d744018'} Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 396d3e73-5c6a-4889-84e6-7a440d744018 could not be found. Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:10:02.631429 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:10:02.633631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:10:02.633631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:10:02.633631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:10:02.633631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:10:02.633631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:10:02.633631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:10:02.633631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:10:02.633631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 396d3e73-5c6a-4889-84e6-7a440d744018 could not be found. Jun 16 15:10:02.633631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:02.633631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:02.633631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:02.633631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:02.633631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:02.633631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:02.633631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:10:02.633631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:10:02.633631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 396d3e73-5c6a-4889-84e6-7a440d744018 could not be found. Jun 16 15:10:02.633631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:02.635816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-15415845-df1c-42a0-aa83-1b00f13dbf0f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Returning 404 to user: Instance 396d3e73-5c6a-4889-84e6-7a440d744018 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:10:02.635816 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-15415845-df1c-42a0-aa83-1b00f13dbf0f tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018" status: 404 len: 111 microversion: 2.1 time: 0.034765 Jun 16 15:10:02.636788 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 661/1333] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:10:02 2022] GET /compute/v2.1/servers/396d3e73-5c6a-4889-84e6-7a440d744018 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:10:03.364166 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3e79a5a6-800c-4246-96c7-60690b244c67 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:03.365490 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3e79a5a6-800c-4246-96c7-60690b244c67 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:10:03.374058 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3e79a5a6-800c-4246-96c7-60690b244c67 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:03.374519 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3e79a5a6-800c-4246-96c7-60690b244c67 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:03.375306 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3e79a5a6-800c-4246-96c7-60690b244c67 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:03.375778 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3e79a5a6-800c-4246-96c7-60690b244c67 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:03.397865 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-3e79a5a6-800c-4246-96c7-60690b244c67 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] HTTP exception thrown: Instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 could not be found. Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3e79a5a6-800c-4246-96c7-60690b244c67 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Request method failure captured: Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: DELETE /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 HTTP/1.1 Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0TMjpgChMWBltqPqlOc2QLsqFboHlFg7Zhv6oU8m-3VLra0wCtdBtTj_z-1OqG7sk_8iOEaxtlGIalQr-G6Bz9vT5IwYPuKye4Llr6wMS6vkPTzMQ4Dq1iDN_uiO6bNTWhTo8q3fke8bdPNcKKH6s83IDG0IfsBVY-RvsFLarne2Lc Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 2a4c67a42f8a405d84d4697a45e962ff Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1860873197 Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 15:10:03.399825 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 15:10:03.401705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2a4c67a42f8a405d84d4697a45e962ff", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a4c67a42f8a405d84d4697a45e962ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a4c67a42f8a405d84d4697a45e962ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2a4c67a42f8a405d84d4697a45e962ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:10:03.401705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1860873197 Jun 16 15:10:03.401705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 2a4c67a42f8a405d84d4697a45e962ff Jun 16 15:10:03.401705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1860873197 Jun 16 15:10:03.401705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeShelveTestJSON-1860873197-project Jun 16 15:10:03.401705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 15:10:03.401705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 15:10:03.401705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: ba40bcf173404e6c8b17d311b65bf780 Jun 16 15:10:03.401705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1860873197-project Jun 16 15:10:03.401705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 15:10:03.401705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 could not be found. Jun 16 15:10:03.401705 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': 'b53e3fc3-e13f-4352-ad2f-7babd83b19e3'} Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 could not be found. Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:10:03.402741 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 could not be found. Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 could not be found. Jun 16 15:10:03.404539 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:10:03.406764 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3e79a5a6-800c-4246-96c7-60690b244c67 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Returning 404 to user: Instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:10:03.408036 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3e79a5a6-800c-4246-96c7-60690b244c67 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "DELETE /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 404 len: 111 microversion: 2.20 time: 0.052656 Jun 16 15:10:03.409085 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 673/1334] 10.222.0.72 () {60 vars in 1279 bytes} [Thu Jun 16 15:10:03 2022] DELETE /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 15:10:03.419345 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8e1d8639-41d7-4241-bcec-66dfbd64aa00 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:03.420034 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8e1d8639-41d7-4241-bcec-66dfbd64aa00 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: b53e3fc3-e13f-4352-ad2f-7babd83b19e3] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:10:03.426582 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8e1d8639-41d7-4241-bcec-66dfbd64aa00 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:03.427041 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8e1d8639-41d7-4241-bcec-66dfbd64aa00 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:03.427877 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8e1d8639-41d7-4241-bcec-66dfbd64aa00 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:03.428321 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8e1d8639-41d7-4241-bcec-66dfbd64aa00 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:03.446459 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-8e1d8639-41d7-4241-bcec-66dfbd64aa00 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] HTTP exception thrown: Instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 could not be found. Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8e1d8639-41d7-4241-bcec-66dfbd64aa00 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Request method failure captured: Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 HTTP/1.1 Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TMjpgChMWBltqPqlOc2QLsqFboHlFg7Zhv6oU8m-3VLra0wCtdBtTj_z-1OqG7sk_8iOEaxtlGIalQr-G6Bz9vT5IwYPuKye4Llr6wMS6vkPTzMQ4Dq1iDN_uiO6bNTWhTo8q3fke8bdPNcKKH6s83IDG0IfsBVY-RvsFLarne2Lc Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 2a4c67a42f8a405d84d4697a45e962ff Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1860873197 Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:10:03.448027 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:10:03.449466 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2a4c67a42f8a405d84d4697a45e962ff", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a4c67a42f8a405d84d4697a45e962ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a4c67a42f8a405d84d4697a45e962ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2a4c67a42f8a405d84d4697a45e962ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:10:03.449466 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1860873197 Jun 16 15:10:03.449466 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 2a4c67a42f8a405d84d4697a45e962ff Jun 16 15:10:03.449466 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1860873197 Jun 16 15:10:03.449466 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeShelveTestJSON-1860873197-project Jun 16 15:10:03.449466 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:10:03.449466 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:10:03.449466 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: ba40bcf173404e6c8b17d311b65bf780 Jun 16 15:10:03.449466 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1860873197-project Jun 16 15:10:03.449466 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:10:03.449466 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 could not be found. Jun 16 15:10:03.449466 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': 'b53e3fc3-e13f-4352-ad2f-7babd83b19e3'} Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 could not be found. Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:10:03.450234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:10:03.451516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:10:03.451516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:10:03.451516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:10:03.451516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:10:03.451516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:10:03.451516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:10:03.451516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:10:03.451516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 could not be found. Jun 16 15:10:03.451516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:03.451516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:03.451516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:03.451516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:03.451516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:03.451516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:03.451516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:10:03.451516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:10:03.451516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 could not be found. Jun 16 15:10:03.451516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:03.453186 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8e1d8639-41d7-4241-bcec-66dfbd64aa00 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Returning 404 to user: Instance b53e3fc3-e13f-4352-ad2f-7babd83b19e3 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:10:03.453186 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8e1d8639-41d7-4241-bcec-66dfbd64aa00 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3" status: 404 len: 111 microversion: 2.20 time: 0.035916 Jun 16 15:10:03.453186 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 662/1335] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:10:03 2022] GET /compute/v2.1/servers/b53e3fc3-e13f-4352-ad2f-7babd83b19e3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 15:10:04.635788 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-605db8a8-7239-41b4-8649-65f3e4ee0494 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:04.636469 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-605db8a8-7239-41b4-8649-65f3e4ee0494 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:10:04.643230 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-605db8a8-7239-41b4-8649-65f3e4ee0494 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:04.643680 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-605db8a8-7239-41b4-8649-65f3e4ee0494 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:04.644442 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-605db8a8-7239-41b4-8649-65f3e4ee0494 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:04.645006 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-605db8a8-7239-41b4-8649-65f3e4ee0494 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:04.660777 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-605db8a8-7239-41b4-8649-65f3e4ee0494 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] HTTP exception thrown: Instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 could not be found. Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-605db8a8-7239-41b4-8649-65f3e4ee0494 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Request method failure captured: Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: DELETE /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 HTTP/1.1 Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TMjpgChMWBltqPqlOc2QLsqFboHlFg7Zhv6oU8m-3VLra0wCtdBtTj_z-1OqG7sk_8iOEaxtlGIalQr-G6Bz9vT5IwYPuKye4Llr6wMS6vkPTzMQ4Dq1iDN_uiO6bNTWhTo8q3fke8bdPNcKKH6s83IDG0IfsBVY-RvsFLarne2Lc Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 2a4c67a42f8a405d84d4697a45e962ff Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1860873197 Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:10:04.662420 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:10:04.664266 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2a4c67a42f8a405d84d4697a45e962ff", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a4c67a42f8a405d84d4697a45e962ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a4c67a42f8a405d84d4697a45e962ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2a4c67a42f8a405d84d4697a45e962ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:10:04.664266 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1860873197 Jun 16 15:10:04.664266 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 2a4c67a42f8a405d84d4697a45e962ff Jun 16 15:10:04.664266 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1860873197 Jun 16 15:10:04.664266 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeShelveTestJSON-1860873197-project Jun 16 15:10:04.664266 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:10:04.664266 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:10:04.664266 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: ba40bcf173404e6c8b17d311b65bf780 Jun 16 15:10:04.664266 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1860873197-project Jun 16 15:10:04.664266 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:10:04.664266 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 could not be found. Jun 16 15:10:04.664266 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': '895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9'} Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 could not be found. Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:10:04.665204 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 could not be found. Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 could not be found. Jun 16 15:10:04.666558 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:04.667881 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-605db8a8-7239-41b4-8649-65f3e4ee0494 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Returning 404 to user: Instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:10:04.667881 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-605db8a8-7239-41b4-8649-65f3e4ee0494 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "DELETE /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 404 len: 111 microversion: 2.20 time: 0.032102 Jun 16 15:10:04.667881 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 663/1336] 10.222.0.72 () {60 vars in 1279 bytes} [Thu Jun 16 15:10:04 2022] DELETE /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 15:10:04.673442 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fd16d00a-ca09-4a08-82cc-1600cb436905 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:04.674179 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fd16d00a-ca09-4a08-82cc-1600cb436905 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] [instance: 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:10:04.681036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fd16d00a-ca09-4a08-82cc-1600cb436905 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:04.681562 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fd16d00a-ca09-4a08-82cc-1600cb436905 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:04.682564 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fd16d00a-ca09-4a08-82cc-1600cb436905 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:04.683228 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fd16d00a-ca09-4a08-82cc-1600cb436905 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:04.706842 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-fd16d00a-ca09-4a08-82cc-1600cb436905 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] HTTP exception thrown: Instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 could not be found. Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fd16d00a-ca09-4a08-82cc-1600cb436905 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Request method failure captured: Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 HTTP/1.1 Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0TMjpgChMWBltqPqlOc2QLsqFboHlFg7Zhv6oU8m-3VLra0wCtdBtTj_z-1OqG7sk_8iOEaxtlGIalQr-G6Bz9vT5IwYPuKye4Llr6wMS6vkPTzMQ4Dq1iDN_uiO6bNTWhTo8q3fke8bdPNcKKH6s83IDG0IfsBVY-RvsFLarne2Lc Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 2a4c67a42f8a405d84d4697a45e962ff Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1860873197 Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:10:04.709499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:10:04.711237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_2a4c67a42f8a405d84d4697a45e962ff", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a4c67a42f8a405d84d4697a45e962ff"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/2a4c67a42f8a405d84d4697a45e962ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/2a4c67a42f8a405d84d4697a45e962ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:10:04.711237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1860873197 Jun 16 15:10:04.711237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 2a4c67a42f8a405d84d4697a45e962ff Jun 16 15:10:04.711237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1860873197 Jun 16 15:10:04.711237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeShelveTestJSON-1860873197-project Jun 16 15:10:04.711237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:10:04.711237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:10:04.711237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: ba40bcf173404e6c8b17d311b65bf780 Jun 16 15:10:04.711237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1860873197-project Jun 16 15:10:04.711237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:10:04.711237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 could not be found. Jun 16 15:10:04.711237 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': '895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9'} Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 could not be found. Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:10:04.712083 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:10:04.713346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:10:04.713346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:10:04.713346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:10:04.713346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:10:04.713346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:10:04.713346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:10:04.713346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:10:04.713346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 could not be found. Jun 16 15:10:04.713346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:04.713346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:04.713346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:04.713346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:04.713346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:04.713346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:04.713346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:10:04.713346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:10:04.713346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 could not be found. Jun 16 15:10:04.713346 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:04.714532 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fd16d00a-ca09-4a08-82cc-1600cb436905 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] Returning 404 to user: Instance 895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:10:04.714532 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fd16d00a-ca09-4a08-82cc-1600cb436905 tempest-AttachVolumeShelveTestJSON-1860873197 tempest-AttachVolumeShelveTestJSON-1860873197-project] 10.222.0.72 "GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9" status: 404 len: 111 microversion: 2.20 time: 0.041461 Jun 16 15:10:04.714532 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 664/1337] 10.222.0.72 () {60 vars in 1276 bytes} [Thu Jun 16 15:10:04 2022] GET /compute/v2.1/servers/895d3ffa-3dc2-4e53-9c8a-1fcf9de52ea9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 15:10:04.758581 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-bb73deba-1c3f-4171-b824-c018627e53bd tempest-VolumesGetTestJSON-1662606621 tempest-VolumesGetTestJSON-1662606621-project] Action: 'create', calling method: .version_select at 0x7faab8138ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-453449448", "metadata": {"Type": "work"}}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:10:05.314457 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-bb73deba-1c3f-4171-b824-c018627e53bd tempest-VolumesGetTestJSON-1662606621 tempest-VolumesGetTestJSON-1662606621-project] 10.222.0.72 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.706922 Jun 16 15:10:05.315080 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 674/1338] 10.222.0.72 () {60 vars in 1155 bytes} [Thu Jun 16 15:10:04 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 708 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 15:10:05.327199 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c871795d-f7de-44c0-a048-55b4c3f9ac62 tempest-VolumesGetTestJSON-1662606621 tempest-VolumesGetTestJSON-1662606621-project] Calling method '.version_select at 0x7faab643f790>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:05.400481 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c871795d-f7de-44c0-a048-55b4c3f9ac62 tempest-VolumesGetTestJSON-1662606621 tempest-VolumesGetTestJSON-1662606621-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/dfeca81e-778b-4dba-b293-dfd6e40279a7" status: 200 len: 352 microversion: 2.1 time: 0.077482 Jun 16 15:10:05.401331 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 665/1339] 10.222.0.72 () {58 vars in 1244 bytes} [Thu Jun 16 15:10:05 2022] GET /compute/v2.1/os-volumes/dfeca81e-778b-4dba-b293-dfd6e40279a7 => generated 352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:10:06.031071 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0f50d4fe-d757-448f-a1a2-2c58177cd84b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:06.031955 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0f50d4fe-d757-448f-a1a2-2c58177cd84b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:10:06.040526 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f50d4fe-d757-448f-a1a2-2c58177cd84b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:06.041010 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f50d4fe-d757-448f-a1a2-2c58177cd84b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:06.041850 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f50d4fe-d757-448f-a1a2-2c58177cd84b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:06.042291 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f50d4fe-d757-448f-a1a2-2c58177cd84b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:06.074113 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0f50d4fe-d757-448f-a1a2-2c58177cd84b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:10:06.193980 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0f50d4fe-d757-448f-a1a2-2c58177cd84b tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "DELETE /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 204 len: 0 microversion: 2.1 time: 0.169970 Jun 16 15:10:06.195284 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 675/1340] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:10:06 2022] DELETE /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:10:06.223759 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6e52aff1-1cd6-400e-bd2b-f5a4238acd8c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:06.226354 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6e52aff1-1cd6-400e-bd2b-f5a4238acd8c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:10:06.250125 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e52aff1-1cd6-400e-bd2b-f5a4238acd8c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:06.250577 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e52aff1-1cd6-400e-bd2b-f5a4238acd8c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:06.251361 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e52aff1-1cd6-400e-bd2b-f5a4238acd8c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:06.251788 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e52aff1-1cd6-400e-bd2b-f5a4238acd8c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:06.297669 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-a10250c6-5402-4f0d-959b-3ada55b2b02b req-0404f200-387d-47d4-afaf-24be2ab36f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4b26a44-c528-4cc8-b427-f43d8f0bc9a9", "tag": "cc43f90e-a572-4f83-9de1-aec44e329893"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:10:06.311904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-a10250c6-5402-4f0d-959b-3ada55b2b02b req-0404f200-387d-47d4-afaf-24be2ab36f2c service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:06.313821 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-a10250c6-5402-4f0d-959b-3ada55b2b02b req-0404f200-387d-47d4-afaf-24be2ab36f2c service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:06.330200 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-a10250c6-5402-4f0d-959b-3ada55b2b02b req-0404f200-387d-47d4-afaf-24be2ab36f2c service nova] Creating event network-changed:cc43f90e-a572-4f83-9de1-aec44e329893 for instance c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 on hv-cinder-83716 Jun 16 15:10:06.337234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-a10250c6-5402-4f0d-959b-3ada55b2b02b req-0404f200-387d-47d4-afaf-24be2ab36f2c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.300252 Jun 16 15:10:06.338628 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 666/1341] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:10:06.417023 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-da400950-247e-4942-bb37-da6df993f993 tempest-VolumesGetTestJSON-1662606621 tempest-VolumesGetTestJSON-1662606621-project] Calling method '.version_select at 0x7faab6441940>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:06.515143 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-da400950-247e-4942-bb37-da6df993f993 tempest-VolumesGetTestJSON-1662606621 tempest-VolumesGetTestJSON-1662606621-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/dfeca81e-778b-4dba-b293-dfd6e40279a7" status: 200 len: 353 microversion: 2.1 time: 0.105047 Jun 16 15:10:06.515940 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 667/1342] 10.222.0.72 () {58 vars in 1244 bytes} [Thu Jun 16 15:10:06 2022] GET /compute/v2.1/os-volumes/dfeca81e-778b-4dba-b293-dfd6e40279a7 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:10:06.539369 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1a0f6528-b654-44f8-b2bb-2f7de8866fa3 tempest-VolumesGetTestJSON-1662606621 tempest-VolumesGetTestJSON-1662606621-project] Calling method '.version_select at 0x7faab6441820>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:06.551218 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6e52aff1-1cd6-400e-bd2b-f5a4238acd8c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:10:06.562227 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6e52aff1-1cd6-400e-bd2b-f5a4238acd8c tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1576 microversion: 2.1 time: 0.362570 Jun 16 15:10:06.563011 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 676/1343] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:10:06 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1576 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:10:06.619507 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1a0f6528-b654-44f8-b2bb-2f7de8866fa3 tempest-VolumesGetTestJSON-1662606621 tempest-VolumesGetTestJSON-1662606621-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/dfeca81e-778b-4dba-b293-dfd6e40279a7" status: 200 len: 353 microversion: 2.1 time: 0.094167 Jun 16 15:10:06.620071 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 668/1344] 10.222.0.72 () {58 vars in 1244 bytes} [Thu Jun 16 15:10:06 2022] GET /compute/v2.1/os-volumes/dfeca81e-778b-4dba-b293-dfd6e40279a7 => generated 353 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:10:06.635711 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fa5efd39-e1ac-4508-9d8c-5622ea3b2f16 tempest-VolumesGetTestJSON-1662606621 tempest-VolumesGetTestJSON-1662606621-project] Calling method '.version_select at 0x7faab5e95700>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:06.721114 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fa5efd39-e1ac-4508-9d8c-5622ea3b2f16 tempest-VolumesGetTestJSON-1662606621 tempest-VolumesGetTestJSON-1662606621-project] 10.222.0.72 "DELETE /compute/v2.1/os-volumes/dfeca81e-778b-4dba-b293-dfd6e40279a7" status: 202 len: 0 microversion: 2.1 time: 0.088218 Jun 16 15:10:06.721759 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 677/1345] 10.222.0.72 () {58 vars in 1247 bytes} [Thu Jun 16 15:10:06 2022] DELETE /compute/v2.1/os-volumes/dfeca81e-778b-4dba-b293-dfd6e40279a7 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:10:06.730629 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-cd567bd6-64b1-4dbd-b1f6-a0d168bbc559 tempest-VolumesGetTestJSON-1662606621 tempest-VolumesGetTestJSON-1662606621-project] Calling method '.version_select at 0x7faab66e4e50>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:06.793471 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-cd567bd6-64b1-4dbd-b1f6-a0d168bbc559 tempest-VolumesGetTestJSON-1662606621 tempest-VolumesGetTestJSON-1662606621-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/dfeca81e-778b-4dba-b293-dfd6e40279a7" status: 200 len: 352 microversion: 2.1 time: 0.066956 Jun 16 15:10:06.794505 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 669/1346] 10.222.0.72 () {58 vars in 1244 bytes} [Thu Jun 16 15:10:06 2022] GET /compute/v2.1/os-volumes/dfeca81e-778b-4dba-b293-dfd6e40279a7 => generated 352 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:10:07.580547 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-66da622c-60b8-4358-930c-fac6b78164a7 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:07.581197 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-66da622c-60b8-4358-930c-fac6b78164a7 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:10:07.596371 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-66da622c-60b8-4358-930c-fac6b78164a7 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:07.596853 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-66da622c-60b8-4358-930c-fac6b78164a7 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:07.603706 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-66da622c-60b8-4358-930c-fac6b78164a7 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:07.604169 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-66da622c-60b8-4358-930c-fac6b78164a7 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:07.807499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c629b67d-0edc-48ab-bdd8-25944101f14c tempest-VolumesGetTestJSON-1662606621 tempest-VolumesGetTestJSON-1662606621-project] Calling method '.version_select at 0x7faab643f430>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:07.860390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-c629b67d-0edc-48ab-bdd8-25944101f14c tempest-VolumesGetTestJSON-1662606621 tempest-VolumesGetTestJSON-1662606621-project] HTTP exception thrown: Volume dfeca81e-778b-4dba-b293-dfd6e40279a7 could not be found. Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c629b67d-0edc-48ab-bdd8-25944101f14c tempest-VolumesGetTestJSON-1662606621 tempest-VolumesGetTestJSON-1662606621-project] Request method failure captured: Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/os-volumes/dfeca81e-778b-4dba-b293-dfd6e40279a7 HTTP/1.1 Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0fM41j1OBhXGOze0Cf4bZAC0Q-wkezTtMe2ioue_NecbntyDq-YgjyGFpLM21ZicdhVwFqGtOBOWwK_f1BF2Y0RhlkcotdyhSC7CLETdyEXYT3mR4FuOTsLfSna3sK_BJxXpSo9TELGYO73u1wDMVYAPb4vRoQyHia7fBu3mmIeDYc Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 806353d0bb7d4b5eb5d1939c58d9ab5c Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-VolumesGetTestJSON-1662606621 Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:10:07.863390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:10:07.865365 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_806353d0bb7d4b5eb5d1939c58d9ab5c", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/806353d0bb7d4b5eb5d1939c58d9ab5c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/806353d0bb7d4b5eb5d1939c58d9ab5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/806353d0bb7d4b5eb5d1939c58d9ab5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:10:07.865365 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-VolumesGetTestJSON-1662606621 Jun 16 15:10:07.865365 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 806353d0bb7d4b5eb5d1939c58d9ab5c Jun 16 15:10:07.865365 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-VolumesGetTestJSON-1662606621 Jun 16 15:10:07.865365 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-VolumesGetTestJSON-1662606621-project Jun 16 15:10:07.865365 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:10:07.865365 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:10:07.865365 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 6b2b8e2cea7247c28500df9e9141b2d7 Jun 16 15:10:07.865365 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-VolumesGetTestJSON-1662606621-project Jun 16 15:10:07.865365 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: Jun 16 15:10:07.865365 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Volume dfeca81e-778b-4dba-b293-dfd6e40279a7 could not be found. Jun 16 15:10:07.865365 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': 'dfeca81e-778b-4dba-b293-dfd6e40279a7'} Jun 16 15:10:07.865365 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:10:07.866271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:07.866271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 15:10:07.866271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 15:10:07.866271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 15:10:07.866271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 15:10:07.866271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 15:10:07.866271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 15:10:07.866271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 15:10:07.866271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 15:10:07.866271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 15:10:07.866271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 15:10:07.866271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 15:10:07.866271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 15:10:07.866271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 15:10:07.866271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 15:10:07.866271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dfeca81e-778b-4dba-b293-dfd6e40279a7 could not be found. (HTTP 404) (Request-ID: req-1c64418b-c199-464b-9fe6-857f63d6e6bc) Jun 16 15:10:07.866271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:07.866271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:07.866271 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:07.867594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:07.867594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 15:10:07.867594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 15:10:07.867594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 15:10:07.867594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 15:10:07.867594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 15:10:07.867594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 15:10:07.867594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 15:10:07.867594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 15:10:07.867594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 15:10:07.867594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 15:10:07.867594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 15:10:07.867594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 15:10:07.867594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 15:10:07.867594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 15:10:07.867594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 15:10:07.867594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 15:10:07.867594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 15:10:07.867594 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 15:10:07.871044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 15:10:07.871044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 15:10:07.871044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 15:10:07.871044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 15:10:07.871044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dfeca81e-778b-4dba-b293-dfd6e40279a7 could not be found. Jun 16 15:10:07.871044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:07.871044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:07.871044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:07.871044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:07.871044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:07.871044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:07.871044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:10:07.871044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:10:07.871044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 15:10:07.871044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 15:10:07.871044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:10:07.871044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:10:07.871044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 15:10:07.871044 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:10:07.875693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dfeca81e-778b-4dba-b293-dfd6e40279a7 could not be found. Jun 16 15:10:07.875693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:07.875693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:07.875693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:07.875693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:07.875693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:07.875693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:07.875693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:10:07.875693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:10:07.875693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dfeca81e-778b-4dba-b293-dfd6e40279a7 could not be found. Jun 16 15:10:07.875693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:07.875693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c629b67d-0edc-48ab-bdd8-25944101f14c tempest-VolumesGetTestJSON-1662606621 tempest-VolumesGetTestJSON-1662606621-project] Returning 404 to user: Volume dfeca81e-778b-4dba-b293-dfd6e40279a7 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:10:07.875693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c629b67d-0edc-48ab-bdd8-25944101f14c tempest-VolumesGetTestJSON-1662606621 tempest-VolumesGetTestJSON-1662606621-project] 10.222.0.72 "GET /compute/v2.1/os-volumes/dfeca81e-778b-4dba-b293-dfd6e40279a7" status: 404 len: 109 microversion: 2.1 time: 0.062518 Jun 16 15:10:07.875693 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 670/1347] 10.222.0.72 () {58 vars in 1244 bytes} [Thu Jun 16 15:10:07 2022] GET /compute/v2.1/os-volumes/dfeca81e-778b-4dba-b293-dfd6e40279a7 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:10:07.878865 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-66da622c-60b8-4358-930c-fac6b78164a7 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:10:07.886580 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-66da622c-60b8-4358-930c-fac6b78164a7 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1576 microversion: 2.1 time: 0.303022 Jun 16 15:10:07.889409 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 678/1348] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:10:07 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1576 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:10:07.977645 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-cd26079d-9e17-449f-b6d8-0b096cc309a2 req-74eaed2e-c803-42f2-af9b-f85bed86083f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4b26a44-c528-4cc8-b427-f43d8f0bc9a9", "name": "network-vif-deleted", "tag": "cc43f90e-a572-4f83-9de1-aec44e329893"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:10:07.997938 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-cd26079d-9e17-449f-b6d8-0b096cc309a2 req-74eaed2e-c803-42f2-af9b-f85bed86083f service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:07.999651 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-cd26079d-9e17-449f-b6d8-0b096cc309a2 req-74eaed2e-c803-42f2-af9b-f85bed86083f service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:08.024572 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-cd26079d-9e17-449f-b6d8-0b096cc309a2 req-74eaed2e-c803-42f2-af9b-f85bed86083f service nova] Creating event network-vif-deleted:cc43f90e-a572-4f83-9de1-aec44e329893 for instance c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 on hv-cinder-83716 Jun 16 15:10:08.036665 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-cd26079d-9e17-449f-b6d8-0b096cc309a2 req-74eaed2e-c803-42f2-af9b-f85bed86083f service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061773 Jun 16 15:10:08.038958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 671/1349] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:10:08.899885 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-280a00b9-74a1-46cb-a90d-3b09456e8e61 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:08.903962 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-280a00b9-74a1-46cb-a90d-3b09456e8e61 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:10:08.919463 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-280a00b9-74a1-46cb-a90d-3b09456e8e61 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:08.920578 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-280a00b9-74a1-46cb-a90d-3b09456e8e61 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:08.922608 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-280a00b9-74a1-46cb-a90d-3b09456e8e61 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:08.923059 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-280a00b9-74a1-46cb-a90d-3b09456e8e61 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:09.001244 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-280a00b9-74a1-46cb-a90d-3b09456e8e61 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:09.001693 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-280a00b9-74a1-46cb-a90d-3b09456e8e61 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:09.002506 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-280a00b9-74a1-46cb-a90d-3b09456e8e61 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lazy-loading 'fault' on Instance uuid c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:10:09.081284 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-280a00b9-74a1-46cb-a90d-3b09456e8e61 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d977f609537476daa8fe8adbab9ff9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05223500b4a142c7a77c2de010541b84', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:10:09.093289 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-280a00b9-74a1-46cb-a90d-3b09456e8e61 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 200 len: 1185 microversion: 2.1 time: 0.196534 Jun 16 15:10:09.093289 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 679/1350] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:10:08 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 1185 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:10:10.107998 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b0ff7339-84fe-40c7-a64d-6fed1a7fa4eb tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:10.108703 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b0ff7339-84fe-40c7-a64d-6fed1a7fa4eb tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: c4b26a44-c528-4cc8-b427-f43d8f0bc9a9] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:10:10.115614 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b0ff7339-84fe-40c7-a64d-6fed1a7fa4eb tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:10.116279 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b0ff7339-84fe-40c7-a64d-6fed1a7fa4eb tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:10.117233 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b0ff7339-84fe-40c7-a64d-6fed1a7fa4eb tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:10.117833 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b0ff7339-84fe-40c7-a64d-6fed1a7fa4eb tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:10.135151 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-b0ff7339-84fe-40c7-a64d-6fed1a7fa4eb tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] HTTP exception thrown: Instance c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 could not be found. Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b0ff7339-84fe-40c7-a64d-6fed1a7fa4eb tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Request method failure captured: Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 HTTP/1.1 Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0VkLo99pEkQDuVjNTisJO2-sG7oVfv7DO08x8fqkx6EcNLLXf80_Hwjc01BE91RTfWmiZQQw1LJU0dTSoF8QgEcvi8VVSaDG7nlQTX7LVqf7oo8X0Fav6HUZko0kB1UBk7hD1FmWT7RPFUB0gIxy-F0bslaVdPohd5b8kzo1NfX-js Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 05223500b4a142c7a77c2de010541b84 Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-TestVolumeBootPattern-2072272021 Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:10:10.137355 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:10:10.139107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_05223500b4a142c7a77c2de010541b84", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/05223500b4a142c7a77c2de010541b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/05223500b4a142c7a77c2de010541b84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/05223500b4a142c7a77c2de010541b84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:10:10.139107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-TestVolumeBootPattern-2072272021 Jun 16 15:10:10.139107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 05223500b4a142c7a77c2de010541b84 Jun 16 15:10:10.139107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-TestVolumeBootPattern-2072272021 Jun 16 15:10:10.139107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-TestVolumeBootPattern-2072272021-project Jun 16 15:10:10.139107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:10:10.139107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:10:10.139107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 9d977f609537476daa8fe8adbab9ff9c Jun 16 15:10:10.139107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-TestVolumeBootPattern-2072272021-project Jun 16 15:10:10.139107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:10:10.139107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 could not be found. Jun 16 15:10:10.139107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': 'c4b26a44-c528-4cc8-b427-f43d8f0bc9a9'} Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 could not be found. Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:10:10.140063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:10:10.141635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:10:10.141635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:10:10.141635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:10:10.141635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:10:10.141635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:10:10.141635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:10:10.141635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:10:10.141635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 could not be found. Jun 16 15:10:10.141635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:10.141635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:10.141635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:10.141635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:10.141635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:10.141635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:10.141635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:10:10.141635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:10:10.141635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 could not be found. Jun 16 15:10:10.141635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:10.143804 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b0ff7339-84fe-40c7-a64d-6fed1a7fa4eb tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Returning 404 to user: Instance c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:10:10.145029 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b0ff7339-84fe-40c7-a64d-6fed1a7fa4eb tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9" status: 404 len: 111 microversion: 2.1 time: 0.042048 Jun 16 15:10:10.146269 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 672/1351] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:10:10 2022] GET /compute/v2.1/servers/c4b26a44-c528-4cc8-b427-f43d8f0bc9a9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:10:10.737311 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0e431435-4959-4f26-837c-887fa537a76d tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:10.737912 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0e431435-4959-4f26-837c-887fa537a76d tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:10:10.745330 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0e431435-4959-4f26-837c-887fa537a76d tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:10.746207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0e431435-4959-4f26-837c-887fa537a76d tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:10.747551 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0e431435-4959-4f26-837c-887fa537a76d tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:10.748204 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0e431435-4959-4f26-837c-887fa537a76d tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:10.769241 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-0e431435-4959-4f26-837c-887fa537a76d tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] HTTP exception thrown: Instance 9376dd84-3783-460a-b0af-43ae018a961e could not be found. Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0e431435-4959-4f26-837c-887fa537a76d tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Request method failure captured: Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: DELETE /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e HTTP/1.1 Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0VkLo99pEkQDuVjNTisJO2-sG7oVfv7DO08x8fqkx6EcNLLXf80_Hwjc01BE91RTfWmiZQQw1LJU0dTSoF8QgEcvi8VVSaDG7nlQTX7LVqf7oo8X0Fav6HUZko0kB1UBk7hD1FmWT7RPFUB0gIxy-F0bslaVdPohd5b8kzo1NfX-js Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 05223500b4a142c7a77c2de010541b84 Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-TestVolumeBootPattern-2072272021 Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 15:10:10.771828 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 15:10:10.773474 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_05223500b4a142c7a77c2de010541b84", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/05223500b4a142c7a77c2de010541b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/05223500b4a142c7a77c2de010541b84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/05223500b4a142c7a77c2de010541b84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:10:10.773474 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-TestVolumeBootPattern-2072272021 Jun 16 15:10:10.773474 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 05223500b4a142c7a77c2de010541b84 Jun 16 15:10:10.773474 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-TestVolumeBootPattern-2072272021 Jun 16 15:10:10.773474 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-TestVolumeBootPattern-2072272021-project Jun 16 15:10:10.773474 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 15:10:10.773474 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 15:10:10.773474 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: 9d977f609537476daa8fe8adbab9ff9c Jun 16 15:10:10.773474 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-TestVolumeBootPattern-2072272021-project Jun 16 15:10:10.773474 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 15:10:10.773474 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance 9376dd84-3783-460a-b0af-43ae018a961e could not be found. Jun 16 15:10:10.773474 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': '9376dd84-3783-460a-b0af-43ae018a961e'} Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9376dd84-3783-460a-b0af-43ae018a961e could not be found. Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:10:10.774403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9376dd84-3783-460a-b0af-43ae018a961e could not be found. Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9376dd84-3783-460a-b0af-43ae018a961e could not be found. Jun 16 15:10:10.775877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:10:10.778893 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0e431435-4959-4f26-837c-887fa537a76d tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Returning 404 to user: Instance 9376dd84-3783-460a-b0af-43ae018a961e could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:10:10.780069 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0e431435-4959-4f26-837c-887fa537a76d tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "DELETE /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 404 len: 111 microversion: 2.1 time: 0.046917 Jun 16 15:10:10.780802 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 680/1352] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:10:10 2022] DELETE /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:10:10.792587 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-42b80c29-80f0-4022-8617-464bda9759e4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:10.792963 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-42b80c29-80f0-4022-8617-464bda9759e4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] [instance: 9376dd84-3783-460a-b0af-43ae018a961e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:10:10.799456 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-42b80c29-80f0-4022-8617-464bda9759e4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:10.800003 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-42b80c29-80f0-4022-8617-464bda9759e4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:10.801026 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-42b80c29-80f0-4022-8617-464bda9759e4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:10:10.801635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-42b80c29-80f0-4022-8617-464bda9759e4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:10:10.823098 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-42b80c29-80f0-4022-8617-464bda9759e4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] HTTP exception thrown: Instance 9376dd84-3783-460a-b0af-43ae018a961e could not be found. Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-42b80c29-80f0-4022-8617-464bda9759e4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Request method failure captured: Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e HTTP/1.1 Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0VkLo99pEkQDuVjNTisJO2-sG7oVfv7DO08x8fqkx6EcNLLXf80_Hwjc01BE91RTfWmiZQQw1LJU0dTSoF8QgEcvi8VVSaDG7nlQTX7LVqf7oo8X0Fav6HUZko0kB1UBk7hD1FmWT7RPFUB0gIxy-F0bslaVdPohd5b8kzo1NfX-js Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 05223500b4a142c7a77c2de010541b84 Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-TestVolumeBootPattern-2072272021 Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:10:10.825180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:10:10.826928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_05223500b4a142c7a77c2de010541b84", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/05223500b4a142c7a77c2de010541b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/05223500b4a142c7a77c2de010541b84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/05223500b4a142c7a77c2de010541b84"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:10:10.826928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-TestVolumeBootPattern-2072272021 Jun 16 15:10:10.826928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 05223500b4a142c7a77c2de010541b84 Jun 16 15:10:10.826928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-TestVolumeBootPattern-2072272021 Jun 16 15:10:10.826928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-TestVolumeBootPattern-2072272021-project Jun 16 15:10:10.826928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:10:10.826928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:10:10.826928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 9d977f609537476daa8fe8adbab9ff9c Jun 16 15:10:10.826928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-TestVolumeBootPattern-2072272021-project Jun 16 15:10:10.826928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:10:10.826928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance 9376dd84-3783-460a-b0af-43ae018a961e could not be found. Jun 16 15:10:10.826928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': '9376dd84-3783-460a-b0af-43ae018a961e'} Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9376dd84-3783-460a-b0af-43ae018a961e could not be found. Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:10:10.827851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:10:10.829379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:10:10.829379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:10:10.829379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:10:10.829379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:10:10.829379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:10:10.829379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:10:10.829379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:10:10.829379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9376dd84-3783-460a-b0af-43ae018a961e could not be found. Jun 16 15:10:10.829379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:10.829379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:10:10.829379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:10.829379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:10:10.829379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:10:10.829379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:10:10.829379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:10:10.829379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:10:10.829379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9376dd84-3783-460a-b0af-43ae018a961e could not be found. Jun 16 15:10:10.829379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:10:10.830958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-42b80c29-80f0-4022-8617-464bda9759e4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Returning 404 to user: Instance 9376dd84-3783-460a-b0af-43ae018a961e could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:10:10.831828 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-42b80c29-80f0-4022-8617-464bda9759e4 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e" status: 404 len: 111 microversion: 2.1 time: 0.045693 Jun 16 15:10:10.832384 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 673/1353] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:10:10 2022] GET /compute/v2.1/servers/9376dd84-3783-460a-b0af-43ae018a961e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:10:12.256731 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-86b7eac2-ccc8-4419-af1d-bd540172af41 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] Calling method '.version_select at 0x7faab5e73310>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:10:12.287015 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-86b7eac2-ccc8-4419-af1d-bd540172af41 tempest-TestVolumeBootPattern-2072272021 tempest-TestVolumeBootPattern-2072272021-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1659470293" status: 202 len: 0 microversion: 2.1 time: 0.035448 Jun 16 15:10:12.290860 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 681/1354] 10.222.0.72 () {58 vars in 1262 bytes} [Thu Jun 16 15:10:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1659470293 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:10:46.418718 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:10:46.419391 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Thu Jun 16 15:10:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:10:46.980476 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:10:46.981100 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Thu Jun 16 15:10:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:11:05.524747 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7f1793c2-1e2e-4dfb-be5e-6e2d07db7f88 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:11:05.525419 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7f1793c2-1e2e-4dfb-be5e-6e2d07db7f88 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:05.527535 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=19 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:05.528342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=51 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:05.535606 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7f1793c2-1e2e-4dfb-be5e-6e2d07db7f88 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:05.536065 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7f1793c2-1e2e-4dfb-be5e-6e2d07db7f88 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:05.536867 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7f1793c2-1e2e-4dfb-be5e-6e2d07db7f88 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:05.537308 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7f1793c2-1e2e-4dfb-be5e-6e2d07db7f88 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:05.560997 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-7f1793c2-1e2e-4dfb-be5e-6e2d07db7f88 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lazy-loading 'flavor' on Instance uuid 781db76b-7a5f-47b1-8272-b4868d68c437 {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:11:05.635915 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7f1793c2-1e2e-4dfb-be5e-6e2d07db7f88 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "POST /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437/action" status: 202 len: 0 microversion: 2.1 time: 0.115539 Jun 16 15:11:05.636712 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 674/1355] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Jun 16 15:11:05 2022] POST /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 15:11:05.642163 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:05.643492 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:05.648739 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0b547c0e-7506-4502-ad4a-b9a6d96e5beb tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:05.649427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0b547c0e-7506-4502-ad4a-b9a6d96e5beb tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:05.659908 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0b547c0e-7506-4502-ad4a-b9a6d96e5beb tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:05.660682 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0b547c0e-7506-4502-ad4a-b9a6d96e5beb tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:05.661780 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0b547c0e-7506-4502-ad4a-b9a6d96e5beb tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:05.662225 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0b547c0e-7506-4502-ad4a-b9a6d96e5beb tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:06.140942 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0b547c0e-7506-4502-ad4a-b9a6d96e5beb tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:06.148870 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0b547c0e-7506-4502-ad4a-b9a6d96e5beb tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.508038 Jun 16 15:11:06.149433 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 682/1356] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:05 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:07.167746 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ffa74cea-035c-4bf1-8083-c816b37f3eef tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:07.168478 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ffa74cea-035c-4bf1-8083-c816b37f3eef tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:07.174597 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ffa74cea-035c-4bf1-8083-c816b37f3eef tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:07.175053 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ffa74cea-035c-4bf1-8083-c816b37f3eef tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:07.175806 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ffa74cea-035c-4bf1-8083-c816b37f3eef tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:07.176244 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ffa74cea-035c-4bf1-8083-c816b37f3eef tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:07.313291 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ffa74cea-035c-4bf1-8083-c816b37f3eef tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:07.321093 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ffa74cea-035c-4bf1-8083-c816b37f3eef tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.158500 Jun 16 15:11:07.321661 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 675/1357] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:07 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:11:08.339574 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8a9ddf1b-d41f-4c69-9406-f1575ffc764a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:08.340197 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8a9ddf1b-d41f-4c69-9406-f1575ffc764a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:08.347252 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a9ddf1b-d41f-4c69-9406-f1575ffc764a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:08.347702 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a9ddf1b-d41f-4c69-9406-f1575ffc764a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:08.348472 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a9ddf1b-d41f-4c69-9406-f1575ffc764a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:08.349189 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8a9ddf1b-d41f-4c69-9406-f1575ffc764a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:08.498964 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8a9ddf1b-d41f-4c69-9406-f1575ffc764a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:08.507685 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8a9ddf1b-d41f-4c69-9406-f1575ffc764a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.172875 Jun 16 15:11:08.508254 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 683/1358] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:08 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:09.525016 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a6a25829-f89a-4872-ae1a-877eb4438e39 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:09.525583 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a6a25829-f89a-4872-ae1a-877eb4438e39 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:09.532338 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a6a25829-f89a-4872-ae1a-877eb4438e39 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:09.532787 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a6a25829-f89a-4872-ae1a-877eb4438e39 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:09.533950 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a6a25829-f89a-4872-ae1a-877eb4438e39 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:09.534467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a6a25829-f89a-4872-ae1a-877eb4438e39 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:09.669486 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a6a25829-f89a-4872-ae1a-877eb4438e39 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:09.677063 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a6a25829-f89a-4872-ae1a-877eb4438e39 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.155999 Jun 16 15:11:09.677619 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 676/1359] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:09 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:10.694583 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0982f9cc-8e5b-4f9c-84b8-49facae56b7b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:10.695260 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0982f9cc-8e5b-4f9c-84b8-49facae56b7b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:10.701747 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0982f9cc-8e5b-4f9c-84b8-49facae56b7b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:10.702198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0982f9cc-8e5b-4f9c-84b8-49facae56b7b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:10.702962 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0982f9cc-8e5b-4f9c-84b8-49facae56b7b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:10.703400 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0982f9cc-8e5b-4f9c-84b8-49facae56b7b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:10.878379 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0982f9cc-8e5b-4f9c-84b8-49facae56b7b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:10.886866 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0982f9cc-8e5b-4f9c-84b8-49facae56b7b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.196107 Jun 16 15:11:10.887428 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 684/1360] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:10 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:11.904185 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-df6e37da-78eb-4f0e-af10-4e17c6624073 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:11.904802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-df6e37da-78eb-4f0e-af10-4e17c6624073 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:11.911585 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-df6e37da-78eb-4f0e-af10-4e17c6624073 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:11.912038 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-df6e37da-78eb-4f0e-af10-4e17c6624073 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:11.913394 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-df6e37da-78eb-4f0e-af10-4e17c6624073 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:11.913834 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-df6e37da-78eb-4f0e-af10-4e17c6624073 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:12.045537 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-df6e37da-78eb-4f0e-af10-4e17c6624073 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:12.053090 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-df6e37da-78eb-4f0e-af10-4e17c6624073 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.152946 Jun 16 15:11:12.053688 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 677/1361] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:11 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:13.071971 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-10ef60c0-db31-4f8e-980e-76d56084dddd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:13.073038 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-10ef60c0-db31-4f8e-980e-76d56084dddd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:13.081516 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-10ef60c0-db31-4f8e-980e-76d56084dddd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:13.082265 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-10ef60c0-db31-4f8e-980e-76d56084dddd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:13.083407 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-10ef60c0-db31-4f8e-980e-76d56084dddd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:13.084939 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-10ef60c0-db31-4f8e-980e-76d56084dddd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:13.251199 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-10ef60c0-db31-4f8e-980e-76d56084dddd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:13.258637 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-10ef60c0-db31-4f8e-980e-76d56084dddd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.192414 Jun 16 15:11:13.259193 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 685/1362] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:13 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:14.275432 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2b662942-9793-4c33-89b8-0a388d00925a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:14.276136 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2b662942-9793-4c33-89b8-0a388d00925a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:14.282973 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2b662942-9793-4c33-89b8-0a388d00925a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:14.283515 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2b662942-9793-4c33-89b8-0a388d00925a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:14.284658 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2b662942-9793-4c33-89b8-0a388d00925a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:14.285118 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2b662942-9793-4c33-89b8-0a388d00925a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:14.422531 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2b662942-9793-4c33-89b8-0a388d00925a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:14.430974 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2b662942-9793-4c33-89b8-0a388d00925a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.159464 Jun 16 15:11:14.431537 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 678/1363] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:14 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:15.447608 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6817437f-58ef-4164-9bd1-7e2e680d3660 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:15.448221 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6817437f-58ef-4164-9bd1-7e2e680d3660 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:15.454854 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6817437f-58ef-4164-9bd1-7e2e680d3660 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:15.455230 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6817437f-58ef-4164-9bd1-7e2e680d3660 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:15.455989 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6817437f-58ef-4164-9bd1-7e2e680d3660 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:15.456416 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6817437f-58ef-4164-9bd1-7e2e680d3660 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:15.596680 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6817437f-58ef-4164-9bd1-7e2e680d3660 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:15.605259 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6817437f-58ef-4164-9bd1-7e2e680d3660 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.161383 Jun 16 15:11:15.605840 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 686/1364] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:15 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:16.623183 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f7b321e8-9886-42b8-ac4b-c4e3f452c1da tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:16.624349 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f7b321e8-9886-42b8-ac4b-c4e3f452c1da tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:16.631251 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f7b321e8-9886-42b8-ac4b-c4e3f452c1da tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:16.631794 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f7b321e8-9886-42b8-ac4b-c4e3f452c1da tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:16.632639 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f7b321e8-9886-42b8-ac4b-c4e3f452c1da tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:16.633203 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f7b321e8-9886-42b8-ac4b-c4e3f452c1da tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:16.773521 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f7b321e8-9886-42b8-ac4b-c4e3f452c1da tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:16.782092 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f7b321e8-9886-42b8-ac4b-c4e3f452c1da tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.163414 Jun 16 15:11:16.782654 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 679/1365] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:16 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:17.799699 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5d536c8f-04bf-4596-8c06-c1cd9f0f87d3 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:17.800310 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5d536c8f-04bf-4596-8c06-c1cd9f0f87d3 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:17.807611 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d536c8f-04bf-4596-8c06-c1cd9f0f87d3 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:17.808063 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d536c8f-04bf-4596-8c06-c1cd9f0f87d3 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:17.808824 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d536c8f-04bf-4596-8c06-c1cd9f0f87d3 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:17.809285 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d536c8f-04bf-4596-8c06-c1cd9f0f87d3 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:17.944883 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5d536c8f-04bf-4596-8c06-c1cd9f0f87d3 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:17.952334 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5d536c8f-04bf-4596-8c06-c1cd9f0f87d3 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.156501 Jun 16 15:11:17.953126 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 687/1366] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:17 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:18.515802 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e7e836eb-93c6-4890-8b28-05e3f27dbc94 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1264833743", "imageRef": "23371504-a4d6-4064-90b4-87bfd0a15170", "flavorRef": "452", "networks": [{"uuid": "78b26139-d9a4-4f35-bf86-6e837f876733"}]}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:11:18.571938 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-e7e836eb-93c6-4890-8b28-05e3f27dbc94 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] validate_networks() for [('78b26139-d9a4-4f35-bf86-6e837f876733', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:11:18.969421 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7b371d28-bb35-4718-acc6-f8b7efd3eeed tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:18.970025 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7b371d28-bb35-4718-acc6-f8b7efd3eeed tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:18.978473 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7b371d28-bb35-4718-acc6-f8b7efd3eeed tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:18.978940 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7b371d28-bb35-4718-acc6-f8b7efd3eeed tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:18.979704 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7b371d28-bb35-4718-acc6-f8b7efd3eeed tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:18.980138 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7b371d28-bb35-4718-acc6-f8b7efd3eeed tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:19.121156 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7b371d28-bb35-4718-acc6-f8b7efd3eeed tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:19.128655 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7b371d28-bb35-4718-acc6-f8b7efd3eeed tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.163019 Jun 16 15:11:19.129263 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 688/1367] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:18 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:11:19.230199 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-e7e836eb-93c6-4890-8b28-05e3f27dbc94 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:11:19.230635 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-e7e836eb-93c6-4890-8b28-05e3f27dbc94 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:11:19.231114 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-e7e836eb-93c6-4890-8b28-05e3f27dbc94 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:11:19.231532 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-e7e836eb-93c6-4890-8b28-05e3f27dbc94 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:11:19.231951 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-e7e836eb-93c6-4890-8b28-05e3f27dbc94 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:11:19.240893 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e7e836eb-93c6-4890-8b28-05e3f27dbc94 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:19.241351 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e7e836eb-93c6-4890-8b28-05e3f27dbc94 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:19.242163 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e7e836eb-93c6-4890-8b28-05e3f27dbc94 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:19.242607 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e7e836eb-93c6-4890-8b28-05e3f27dbc94 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:19.260115 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-e7e836eb-93c6-4890-8b28-05e3f27dbc94 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Getting quotas for project 4da5b37c95a342eaaa1aee173d381701. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:11:19.264123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-e7e836eb-93c6-4890-8b28-05e3f27dbc94 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Getting quotas for user b952610adaa34e1b8c4d23433bd1558e and project 4da5b37c95a342eaaa1aee173d381701. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:11:19.275928 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e7e836eb-93c6-4890-8b28-05e3f27dbc94 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:11:19.278162 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e7e836eb-93c6-4890-8b28-05e3f27dbc94 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23371504-a4d6-4064-90b4-87bfd0a15170',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:11:19.327399 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e7e836eb-93c6-4890-8b28-05e3f27dbc94 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.815527 Jun 16 15:11:19.328052 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 680/1368] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 15:11:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 15:11:19.338599 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ad6647b4-5e6e-49f1-b524-0ee72523f773 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:19.339598 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ad6647b4-5e6e-49f1-b524-0ee72523f773 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:19.394138 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ad6647b4-5e6e-49f1-b524-0ee72523f773 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:19.401642 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ad6647b4-5e6e-49f1-b524-0ee72523f773 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 200 len: 1219 microversion: 2.1 time: 0.067493 Jun 16 15:11:19.402187 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 689/1369] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:19 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:20.145808 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-38b1296e-8d05-4709-a631-fefed0efb7e1 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:20.146432 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-38b1296e-8d05-4709-a631-fefed0efb7e1 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:20.155701 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-38b1296e-8d05-4709-a631-fefed0efb7e1 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:20.156395 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-38b1296e-8d05-4709-a631-fefed0efb7e1 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:20.157706 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-38b1296e-8d05-4709-a631-fefed0efb7e1 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:20.158162 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-38b1296e-8d05-4709-a631-fefed0efb7e1 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:20.332512 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-38b1296e-8d05-4709-a631-fefed0efb7e1 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:20.341607 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-38b1296e-8d05-4709-a631-fefed0efb7e1 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.199466 Jun 16 15:11:20.342273 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 681/1370] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:20 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:20.419647 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-92356d43-fc35-4590-90f2-e8ab838125d5 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:20.420279 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-92356d43-fc35-4590-90f2-e8ab838125d5 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:20.427366 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-92356d43-fc35-4590-90f2-e8ab838125d5 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:20.427813 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-92356d43-fc35-4590-90f2-e8ab838125d5 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:20.428576 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-92356d43-fc35-4590-90f2-e8ab838125d5 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:20.429037 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-92356d43-fc35-4590-90f2-e8ab838125d5 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:20.496254 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-92356d43-fc35-4590-90f2-e8ab838125d5 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:20.503734 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-92356d43-fc35-4590-90f2-e8ab838125d5 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 200 len: 1271 microversion: 2.1 time: 0.088007 Jun 16 15:11:20.504453 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 690/1371] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:20 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 1271 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:21.362818 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ae67b8c8-9c4e-4f6c-b013-5799a2740839 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:21.363553 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ae67b8c8-9c4e-4f6c-b013-5799a2740839 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:21.371404 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ae67b8c8-9c4e-4f6c-b013-5799a2740839 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:21.372347 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ae67b8c8-9c4e-4f6c-b013-5799a2740839 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:21.373545 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ae67b8c8-9c4e-4f6c-b013-5799a2740839 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:21.373992 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ae67b8c8-9c4e-4f6c-b013-5799a2740839 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:21.520779 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3a43619f-c068-4051-8020-0147d23bc1d9 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:21.521412 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3a43619f-c068-4051-8020-0147d23bc1d9 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:21.528429 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3a43619f-c068-4051-8020-0147d23bc1d9 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:21.529236 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3a43619f-c068-4051-8020-0147d23bc1d9 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:21.530276 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3a43619f-c068-4051-8020-0147d23bc1d9 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:21.530857 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3a43619f-c068-4051-8020-0147d23bc1d9 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:21.607171 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3a43619f-c068-4051-8020-0147d23bc1d9 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:21.615364 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3a43619f-c068-4051-8020-0147d23bc1d9 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 200 len: 1277 microversion: 2.1 time: 0.098459 Jun 16 15:11:21.616403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 691/1372] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:21 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:11:21.942974 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ae67b8c8-9c4e-4f6c-b013-5799a2740839 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:21.950787 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ae67b8c8-9c4e-4f6c-b013-5799a2740839 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.594841 Jun 16 15:11:21.951483 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 682/1373] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:21 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:22.634286 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5fd86f00-f402-47d0-aee4-5b0bb6fc6140 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:22.635102 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5fd86f00-f402-47d0-aee4-5b0bb6fc6140 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:22.641711 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5fd86f00-f402-47d0-aee4-5b0bb6fc6140 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:22.642289 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5fd86f00-f402-47d0-aee4-5b0bb6fc6140 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:22.643054 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5fd86f00-f402-47d0-aee4-5b0bb6fc6140 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:22.643489 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5fd86f00-f402-47d0-aee4-5b0bb6fc6140 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:22.783440 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5fd86f00-f402-47d0-aee4-5b0bb6fc6140 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:22.792146 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5fd86f00-f402-47d0-aee4-5b0bb6fc6140 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 200 len: 1319 microversion: 2.1 time: 0.162304 Jun 16 15:11:22.792714 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 692/1374] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:22 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:22.880659 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-8e6d172e-1b56-4913-b637-9329a592d6e6 req-eea3077c-1681-4c02-b33b-dec4944979ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69bb93ad-c721-4619-8402-14d8ca3a7d2d", "tag": "a6ceb248-35be-4c1a-9d9a-18fd3d01c966"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:11:22.892348 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-8e6d172e-1b56-4913-b637-9329a592d6e6 req-eea3077c-1681-4c02-b33b-dec4944979ec service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:22.892807 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-8e6d172e-1b56-4913-b637-9329a592d6e6 req-eea3077c-1681-4c02-b33b-dec4944979ec service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:22.904069 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-8e6d172e-1b56-4913-b637-9329a592d6e6 req-eea3077c-1681-4c02-b33b-dec4944979ec service nova] Creating event network-changed:a6ceb248-35be-4c1a-9d9a-18fd3d01c966 for instance 69bb93ad-c721-4619-8402-14d8ca3a7d2d on hv-cinder-83716 Jun 16 15:11:22.909390 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-8e6d172e-1b56-4913-b637-9329a592d6e6 req-eea3077c-1681-4c02-b33b-dec4944979ec service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032547 Jun 16 15:11:22.909976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 683/1375] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:11:22.969691 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6a01ea08-e73a-499a-9397-1ec504bebf6b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:22.970360 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6a01ea08-e73a-499a-9397-1ec504bebf6b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:22.977755 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6a01ea08-e73a-499a-9397-1ec504bebf6b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:22.978198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6a01ea08-e73a-499a-9397-1ec504bebf6b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:22.978995 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6a01ea08-e73a-499a-9397-1ec504bebf6b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:22.979441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6a01ea08-e73a-499a-9397-1ec504bebf6b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:23.114355 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6a01ea08-e73a-499a-9397-1ec504bebf6b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:23.122422 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6a01ea08-e73a-499a-9397-1ec504bebf6b tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.156638 Jun 16 15:11:23.122975 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 693/1376] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:22 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:23.810111 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-98f0dd7a-db8e-436e-921f-869d53ec4fc7 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:23.810819 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-98f0dd7a-db8e-436e-921f-869d53ec4fc7 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:23.817133 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-98f0dd7a-db8e-436e-921f-869d53ec4fc7 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:23.817592 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-98f0dd7a-db8e-436e-921f-869d53ec4fc7 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:23.818366 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-98f0dd7a-db8e-436e-921f-869d53ec4fc7 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:23.818810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-98f0dd7a-db8e-436e-921f-869d53ec4fc7 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:23.948616 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-98f0dd7a-db8e-436e-921f-869d53ec4fc7 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:23.956096 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-98f0dd7a-db8e-436e-921f-869d53ec4fc7 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 200 len: 1319 microversion: 2.1 time: 0.150207 Jun 16 15:11:23.956660 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 684/1377] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:23 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:24.139443 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fbdfaa3a-48fc-471d-bcc8-5d087e7e0274 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:24.139985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fbdfaa3a-48fc-471d-bcc8-5d087e7e0274 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:24.146975 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fbdfaa3a-48fc-471d-bcc8-5d087e7e0274 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:24.147427 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fbdfaa3a-48fc-471d-bcc8-5d087e7e0274 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:24.148174 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fbdfaa3a-48fc-471d-bcc8-5d087e7e0274 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:24.148603 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fbdfaa3a-48fc-471d-bcc8-5d087e7e0274 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:24.279248 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fbdfaa3a-48fc-471d-bcc8-5d087e7e0274 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:24.287063 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fbdfaa3a-48fc-471d-bcc8-5d087e7e0274 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.151633 Jun 16 15:11:24.287665 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 694/1378] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:24 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:24.972812 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d777b687-bd56-4617-8515-1d60e05094c2 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:24.973449 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d777b687-bd56-4617-8515-1d60e05094c2 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:24.979504 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d777b687-bd56-4617-8515-1d60e05094c2 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:24.979950 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d777b687-bd56-4617-8515-1d60e05094c2 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:24.980701 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d777b687-bd56-4617-8515-1d60e05094c2 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:24.981165 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d777b687-bd56-4617-8515-1d60e05094c2 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:25.110910 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d777b687-bd56-4617-8515-1d60e05094c2 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:25.118949 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d777b687-bd56-4617-8515-1d60e05094c2 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 200 len: 1319 microversion: 2.1 time: 0.150089 Jun 16 15:11:25.119505 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 685/1379] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:24 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:25.304688 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b10e878e-21a7-4aec-8e81-b08ed315eaa2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:25.305326 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b10e878e-21a7-4aec-8e81-b08ed315eaa2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:25.312331 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b10e878e-21a7-4aec-8e81-b08ed315eaa2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:25.312783 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b10e878e-21a7-4aec-8e81-b08ed315eaa2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:25.313577 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b10e878e-21a7-4aec-8e81-b08ed315eaa2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:25.314016 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b10e878e-21a7-4aec-8e81-b08ed315eaa2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:25.443389 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b10e878e-21a7-4aec-8e81-b08ed315eaa2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:25.450995 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b10e878e-21a7-4aec-8e81-b08ed315eaa2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.150188 Jun 16 15:11:25.451582 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 695/1380] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:25 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:26.136257 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a8f231e0-e659-46a0-ab95-d8d0030ca936 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:26.136869 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a8f231e0-e659-46a0-ab95-d8d0030ca936 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:26.143768 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8f231e0-e659-46a0-ab95-d8d0030ca936 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:26.144224 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8f231e0-e659-46a0-ab95-d8d0030ca936 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:26.145060 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8f231e0-e659-46a0-ab95-d8d0030ca936 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:26.145499 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8f231e0-e659-46a0-ab95-d8d0030ca936 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:26.278171 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a8f231e0-e659-46a0-ab95-d8d0030ca936 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:26.285796 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a8f231e0-e659-46a0-ab95-d8d0030ca936 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 200 len: 1319 microversion: 2.1 time: 0.153545 Jun 16 15:11:26.286356 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 686/1381] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:26 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:26.467974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9f2f9496-ccd0-4183-9680-4af849dde58e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:26.468531 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9f2f9496-ccd0-4183-9680-4af849dde58e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:26.475062 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9f2f9496-ccd0-4183-9680-4af849dde58e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:26.475507 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9f2f9496-ccd0-4183-9680-4af849dde58e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:26.476288 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9f2f9496-ccd0-4183-9680-4af849dde58e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:26.476720 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9f2f9496-ccd0-4183-9680-4af849dde58e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:26.608650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9f2f9496-ccd0-4183-9680-4af849dde58e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:26.616143 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9f2f9496-ccd0-4183-9680-4af849dde58e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.152082 Jun 16 15:11:26.616707 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 696/1382] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:26 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:27.301830 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ebf3e868-57f2-4a2f-852e-4c189e3d5639 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:27.302434 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ebf3e868-57f2-4a2f-852e-4c189e3d5639 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:27.309546 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ebf3e868-57f2-4a2f-852e-4c189e3d5639 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:27.309993 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ebf3e868-57f2-4a2f-852e-4c189e3d5639 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:27.310754 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ebf3e868-57f2-4a2f-852e-4c189e3d5639 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:27.311185 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ebf3e868-57f2-4a2f-852e-4c189e3d5639 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:27.527226 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ebf3e868-57f2-4a2f-852e-4c189e3d5639 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:27.538845 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ebf3e868-57f2-4a2f-852e-4c189e3d5639 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 200 len: 1319 microversion: 2.1 time: 0.240483 Jun 16 15:11:27.540025 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 687/1383] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:27 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:11:27.633662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e87073dc-6297-4655-8b8c-2fb8c7b8b441 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:27.634469 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e87073dc-6297-4655-8b8c-2fb8c7b8b441 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:27.641060 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e87073dc-6297-4655-8b8c-2fb8c7b8b441 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:27.641817 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e87073dc-6297-4655-8b8c-2fb8c7b8b441 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:27.642666 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e87073dc-6297-4655-8b8c-2fb8c7b8b441 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:27.643181 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e87073dc-6297-4655-8b8c-2fb8c7b8b441 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:27.814999 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e87073dc-6297-4655-8b8c-2fb8c7b8b441 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:27.824129 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e87073dc-6297-4655-8b8c-2fb8c7b8b441 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.194866 Jun 16 15:11:27.828884 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 697/1384] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:27 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:28.556076 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-651779a4-afb0-48b1-aa67-8bd8615e6775 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:28.556681 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-651779a4-afb0-48b1-aa67-8bd8615e6775 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:28.563186 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-651779a4-afb0-48b1-aa67-8bd8615e6775 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:28.563638 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-651779a4-afb0-48b1-aa67-8bd8615e6775 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:28.564397 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-651779a4-afb0-48b1-aa67-8bd8615e6775 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:28.564855 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-651779a4-afb0-48b1-aa67-8bd8615e6775 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:28.699048 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-651779a4-afb0-48b1-aa67-8bd8615e6775 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:28.706369 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-651779a4-afb0-48b1-aa67-8bd8615e6775 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 200 len: 1319 microversion: 2.1 time: 0.154811 Jun 16 15:11:28.706932 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 688/1385] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:28 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:28.841518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c87dc82f-0431-4f0d-927e-a6b9885c2c91 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:28.842037 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c87dc82f-0431-4f0d-927e-a6b9885c2c91 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:28.848572 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c87dc82f-0431-4f0d-927e-a6b9885c2c91 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:28.849064 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c87dc82f-0431-4f0d-927e-a6b9885c2c91 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:28.849826 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c87dc82f-0431-4f0d-927e-a6b9885c2c91 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:28.850266 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c87dc82f-0431-4f0d-927e-a6b9885c2c91 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:28.985999 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c87dc82f-0431-4f0d-927e-a6b9885c2c91 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:28.994964 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c87dc82f-0431-4f0d-927e-a6b9885c2c91 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.157265 Jun 16 15:11:28.995540 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 698/1386] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:28 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:29.723181 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-36c49aa5-72ed-4f27-b3ee-96ec3c5ce6c4 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:29.723883 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-36c49aa5-72ed-4f27-b3ee-96ec3c5ce6c4 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:29.725920 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:29.726706 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=6 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:29.732950 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-36c49aa5-72ed-4f27-b3ee-96ec3c5ce6c4 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:29.733411 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-36c49aa5-72ed-4f27-b3ee-96ec3c5ce6c4 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:29.734177 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-36c49aa5-72ed-4f27-b3ee-96ec3c5ce6c4 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:29.734619 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-36c49aa5-72ed-4f27-b3ee-96ec3c5ce6c4 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:29.861643 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-36c49aa5-72ed-4f27-b3ee-96ec3c5ce6c4 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:29.865034 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:29.869871 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-36c49aa5-72ed-4f27-b3ee-96ec3c5ce6c4 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 200 len: 1319 microversion: 2.1 time: 0.150535 Jun 16 15:11:29.870438 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 689/1387] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:29 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:30.012046 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5a095625-1e69-4717-a7e5-ebf8dad7a035 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:30.012639 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5a095625-1e69-4717-a7e5-ebf8dad7a035 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:30.014559 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:30.020348 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5a095625-1e69-4717-a7e5-ebf8dad7a035 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:30.020800 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5a095625-1e69-4717-a7e5-ebf8dad7a035 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:30.021597 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5a095625-1e69-4717-a7e5-ebf8dad7a035 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:30.022031 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5a095625-1e69-4717-a7e5-ebf8dad7a035 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:30.041410 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:30.176592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5a095625-1e69-4717-a7e5-ebf8dad7a035 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:30.185569 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5a095625-1e69-4717-a7e5-ebf8dad7a035 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.177312 Jun 16 15:11:30.195774 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 699/1388] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:30 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:30.886908 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-57fb8098-cf3f-418b-9f81-2e072768a0cc tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:30.887567 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-57fb8098-cf3f-418b-9f81-2e072768a0cc tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:30.896359 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57fb8098-cf3f-418b-9f81-2e072768a0cc tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:30.896806 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57fb8098-cf3f-418b-9f81-2e072768a0cc tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:30.897600 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57fb8098-cf3f-418b-9f81-2e072768a0cc tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:30.898036 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57fb8098-cf3f-418b-9f81-2e072768a0cc tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:31.032542 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-57fb8098-cf3f-418b-9f81-2e072768a0cc tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:31.040300 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-57fb8098-cf3f-418b-9f81-2e072768a0cc tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 200 len: 1319 microversion: 2.1 time: 0.157419 Jun 16 15:11:31.040961 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 690/1389] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:30 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:31.203480 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ac9fa3d2-3358-474d-aa80-7f6c2e5405fd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:31.204188 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ac9fa3d2-3358-474d-aa80-7f6c2e5405fd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:31.210911 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ac9fa3d2-3358-474d-aa80-7f6c2e5405fd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:31.211368 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ac9fa3d2-3358-474d-aa80-7f6c2e5405fd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:31.212135 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ac9fa3d2-3358-474d-aa80-7f6c2e5405fd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:31.212575 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ac9fa3d2-3358-474d-aa80-7f6c2e5405fd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:31.350613 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ac9fa3d2-3358-474d-aa80-7f6c2e5405fd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:31.358443 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ac9fa3d2-3358-474d-aa80-7f6c2e5405fd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1511 microversion: 2.1 time: 0.158926 Jun 16 15:11:31.359018 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 700/1390] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:31 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:31.376467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e8e9417d-808d-44a7-9702-cb89df0cede9 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:11:31.377073 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e8e9417d-808d-44a7-9702-cb89df0cede9 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:31.383177 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e8e9417d-808d-44a7-9702-cb89df0cede9 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:31.383631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e8e9417d-808d-44a7-9702-cb89df0cede9 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:31.384393 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e8e9417d-808d-44a7-9702-cb89df0cede9 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:31.384832 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e8e9417d-808d-44a7-9702-cb89df0cede9 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:31.469032 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e8e9417d-808d-44a7-9702-cb89df0cede9 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "POST /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437/action" status: 202 len: 0 microversion: 2.1 time: 0.097148 Jun 16 15:11:31.469641 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 691/1391] 10.222.0.72 () {60 vars in 1277 bytes} [Thu Jun 16 15:11:31 2022] POST /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 15:11:31.478123 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-67c73b14-b09a-4567-a843-832698652e4a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:31.478735 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-67c73b14-b09a-4567-a843-832698652e4a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:31.485508 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-67c73b14-b09a-4567-a843-832698652e4a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:31.485968 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-67c73b14-b09a-4567-a843-832698652e4a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:31.486765 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-67c73b14-b09a-4567-a843-832698652e4a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:31.487377 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-67c73b14-b09a-4567-a843-832698652e4a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:31.689496 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-67c73b14-b09a-4567-a843-832698652e4a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:31.697287 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-67c73b14-b09a-4567-a843-832698652e4a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1519 microversion: 2.1 time: 0.223413 Jun 16 15:11:31.697862 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 701/1392] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:31 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1519 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:11:31.941969 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-cc8d8f75-47f9-4464-b025-7747b6cb3cc8 req-51c9563d-6d95-485a-a36a-18b8d97ad18d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781db76b-7a5f-47b1-8272-b4868d68c437", "name": "network-vif-unplugged", "status": "completed", "tag": "328671dd-12a3-45cf-9250-1f0f36195bba"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:11:31.956549 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-cc8d8f75-47f9-4464-b025-7747b6cb3cc8 req-51c9563d-6d95-485a-a36a-18b8d97ad18d service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:31.957345 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-cc8d8f75-47f9-4464-b025-7747b6cb3cc8 req-51c9563d-6d95-485a-a36a-18b8d97ad18d service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:31.975530 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.compute.server_external_events [req-cc8d8f75-47f9-4464-b025-7747b6cb3cc8 req-51c9563d-6d95-485a-a36a-18b8d97ad18d service nova] Unable to find a host for instance 781db76b-7a5f-47b1-8272-b4868d68c437. Dropping event network-vif-unplugged {{(pid=124590) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 15:11:31.977106 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-cc8d8f75-47f9-4464-b025-7747b6cb3cc8 req-51c9563d-6d95-485a-a36a-18b8d97ad18d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040551 Jun 16 15:11:31.978273 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 692/1393] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 15:11:32.061426 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e0b922fe-e6c5-48cd-81c3-de73695d906c tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:32.063412 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e0b922fe-e6c5-48cd-81c3-de73695d906c tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:32.072560 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e0b922fe-e6c5-48cd-81c3-de73695d906c tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:32.073040 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e0b922fe-e6c5-48cd-81c3-de73695d906c tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:32.073819 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e0b922fe-e6c5-48cd-81c3-de73695d906c tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:32.074253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e0b922fe-e6c5-48cd-81c3-de73695d906c tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:32.215700 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e0b922fe-e6c5-48cd-81c3-de73695d906c tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:32.223127 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e0b922fe-e6c5-48cd-81c3-de73695d906c tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 200 len: 1319 microversion: 2.1 time: 0.167481 Jun 16 15:11:32.223702 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 702/1394] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:32 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:32.713914 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4338ece9-84fa-41b5-987a-e484d73d3d40 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:32.714600 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4338ece9-84fa-41b5-987a-e484d73d3d40 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:32.720922 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4338ece9-84fa-41b5-987a-e484d73d3d40 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:32.721379 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4338ece9-84fa-41b5-987a-e484d73d3d40 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:32.722145 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4338ece9-84fa-41b5-987a-e484d73d3d40 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:32.722599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4338ece9-84fa-41b5-987a-e484d73d3d40 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:32.857967 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4338ece9-84fa-41b5-987a-e484d73d3d40 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:32.866512 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4338ece9-84fa-41b5-987a-e484d73d3d40 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1521 microversion: 2.1 time: 0.156490 Jun 16 15:11:32.867106 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 693/1395] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:32 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:33.239409 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1356932a-6ec8-4d09-878c-e58f7855f8a3 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:33.240070 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1356932a-6ec8-4d09-878c-e58f7855f8a3 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:33.246537 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1356932a-6ec8-4d09-878c-e58f7855f8a3 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:33.246983 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1356932a-6ec8-4d09-878c-e58f7855f8a3 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:33.247732 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1356932a-6ec8-4d09-878c-e58f7855f8a3 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:33.248165 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1356932a-6ec8-4d09-878c-e58f7855f8a3 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:33.379374 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1356932a-6ec8-4d09-878c-e58f7855f8a3 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:33.387220 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1356932a-6ec8-4d09-878c-e58f7855f8a3 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 200 len: 1319 microversion: 2.1 time: 0.151629 Jun 16 15:11:33.387791 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 703/1396] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:33 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:33.884092 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-26547a43-5c26-4cf8-8938-a67a909bbe0e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:33.885827 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-26547a43-5c26-4cf8-8938-a67a909bbe0e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:33.892670 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-26547a43-5c26-4cf8-8938-a67a909bbe0e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:33.893172 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-26547a43-5c26-4cf8-8938-a67a909bbe0e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:33.893940 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-26547a43-5c26-4cf8-8938-a67a909bbe0e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:33.894391 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-26547a43-5c26-4cf8-8938-a67a909bbe0e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:33.995003 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-763a416d-23e8-4ef9-99fe-eac47989b751 req-08fbac07-f02e-41ee-9a1d-0999c2050b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bb93ad-c721-4619-8402-14d8ca3a7d2d", "name": "network-vif-plugged", "status": "completed", "tag": "a6ceb248-35be-4c1a-9d9a-18fd3d01c966"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:11:34.003075 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-763a416d-23e8-4ef9-99fe-eac47989b751 req-08fbac07-f02e-41ee-9a1d-0999c2050b4d service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:34.003527 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-763a416d-23e8-4ef9-99fe-eac47989b751 req-08fbac07-f02e-41ee-9a1d-0999c2050b4d service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:34.015248 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-763a416d-23e8-4ef9-99fe-eac47989b751 req-08fbac07-f02e-41ee-9a1d-0999c2050b4d service nova] Creating event network-vif-plugged:a6ceb248-35be-4c1a-9d9a-18fd3d01c966 for instance 69bb93ad-c721-4619-8402-14d8ca3a7d2d on hv-cinder-83716 Jun 16 15:11:34.020341 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-763a416d-23e8-4ef9-99fe-eac47989b751 req-08fbac07-f02e-41ee-9a1d-0999c2050b4d service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029157 Jun 16 15:11:34.020965 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 704/1397] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 15:11:34.026428 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-26547a43-5c26-4cf8-8938-a67a909bbe0e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:34.034234 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-26547a43-5c26-4cf8-8938-a67a909bbe0e tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1577 microversion: 2.1 time: 0.154453 Jun 16 15:11:34.034790 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 694/1398] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:33 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:34.407209 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-db4c889e-2b97-4def-8c1a-1f8d81c0cda7 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:34.407913 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-db4c889e-2b97-4def-8c1a-1f8d81c0cda7 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:34.414917 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-db4c889e-2b97-4def-8c1a-1f8d81c0cda7 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:34.415373 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-db4c889e-2b97-4def-8c1a-1f8d81c0cda7 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:34.416137 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-db4c889e-2b97-4def-8c1a-1f8d81c0cda7 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:34.416573 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-db4c889e-2b97-4def-8c1a-1f8d81c0cda7 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:34.547548 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-db4c889e-2b97-4def-8c1a-1f8d81c0cda7 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:34.555213 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-db4c889e-2b97-4def-8c1a-1f8d81c0cda7 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 200 len: 1319 microversion: 2.1 time: 0.152285 Jun 16 15:11:34.555778 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 705/1399] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:34 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:35.051190 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-82eaf50d-2c66-431f-b31f-b94c10a68ebd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:35.051744 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-82eaf50d-2c66-431f-b31f-b94c10a68ebd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:35.058359 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82eaf50d-2c66-431f-b31f-b94c10a68ebd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:35.058817 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82eaf50d-2c66-431f-b31f-b94c10a68ebd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:35.059585 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82eaf50d-2c66-431f-b31f-b94c10a68ebd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:35.060034 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82eaf50d-2c66-431f-b31f-b94c10a68ebd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:35.187940 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-82eaf50d-2c66-431f-b31f-b94c10a68ebd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:35.195491 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-82eaf50d-2c66-431f-b31f-b94c10a68ebd tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1577 microversion: 2.1 time: 0.148242 Jun 16 15:11:35.196059 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 695/1400] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:35 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:35.572056 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5ace8412-977a-4291-b5ed-7237350ff4bb tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:35.572693 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5ace8412-977a-4291-b5ed-7237350ff4bb tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:35.579210 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5ace8412-977a-4291-b5ed-7237350ff4bb tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:35.579662 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5ace8412-977a-4291-b5ed-7237350ff4bb tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:35.580421 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5ace8412-977a-4291-b5ed-7237350ff4bb tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:35.580875 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5ace8412-977a-4291-b5ed-7237350ff4bb tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:35.706774 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5ace8412-977a-4291-b5ed-7237350ff4bb tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:35.715334 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5ace8412-977a-4291-b5ed-7237350ff4bb tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 200 len: 1319 microversion: 2.1 time: 0.147158 Jun 16 15:11:35.715891 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 706/1401] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:35 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:36.212490 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d054609e-f612-4752-a161-ca340f3c27ad tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:36.213124 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d054609e-f612-4752-a161-ca340f3c27ad tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:36.215457 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:36.222386 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d054609e-f612-4752-a161-ca340f3c27ad tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:36.222871 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d054609e-f612-4752-a161-ca340f3c27ad tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:36.224078 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d054609e-f612-4752-a161-ca340f3c27ad tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:36.225025 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d054609e-f612-4752-a161-ca340f3c27ad tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:36.362016 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d054609e-f612-4752-a161-ca340f3c27ad tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:36.370240 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d054609e-f612-4752-a161-ca340f3c27ad tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1577 microversion: 2.1 time: 0.161592 Jun 16 15:11:36.370810 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 696/1402] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:36 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:36.731473 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-dc535644-a3c8-4a0e-a995-774ae60a2cfd tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:36.732060 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-dc535644-a3c8-4a0e-a995-774ae60a2cfd tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:36.734483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=53 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:11:36.739941 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dc535644-a3c8-4a0e-a995-774ae60a2cfd tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:36.740989 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dc535644-a3c8-4a0e-a995-774ae60a2cfd tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:36.741756 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dc535644-a3c8-4a0e-a995-774ae60a2cfd tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:36.742198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dc535644-a3c8-4a0e-a995-774ae60a2cfd tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:36.880791 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-dc535644-a3c8-4a0e-a995-774ae60a2cfd tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:36.888299 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-dc535644-a3c8-4a0e-a995-774ae60a2cfd tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 200 len: 1508 microversion: 2.1 time: 0.160669 Jun 16 15:11:36.888869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 707/1403] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:36 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:37.387647 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-701c9f4b-dd67-4f30-b80a-fda1ed23bd1c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:37.388262 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-701c9f4b-dd67-4f30-b80a-fda1ed23bd1c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:37.394969 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-701c9f4b-dd67-4f30-b80a-fda1ed23bd1c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:37.395419 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-701c9f4b-dd67-4f30-b80a-fda1ed23bd1c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:37.396221 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-701c9f4b-dd67-4f30-b80a-fda1ed23bd1c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:37.397239 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-701c9f4b-dd67-4f30-b80a-fda1ed23bd1c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:37.534572 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-701c9f4b-dd67-4f30-b80a-fda1ed23bd1c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:37.542110 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-701c9f4b-dd67-4f30-b80a-fda1ed23bd1c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1577 microversion: 2.1 time: 0.158344 Jun 16 15:11:37.542658 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 697/1404] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:37 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:38.560505 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9a4d9209-53f8-4aea-9a74-d47f59facca5 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:38.561198 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9a4d9209-53f8-4aea-9a74-d47f59facca5 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:38.567862 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a4d9209-53f8-4aea-9a74-d47f59facca5 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:38.568362 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a4d9209-53f8-4aea-9a74-d47f59facca5 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:38.569167 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a4d9209-53f8-4aea-9a74-d47f59facca5 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:38.569604 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a4d9209-53f8-4aea-9a74-d47f59facca5 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:38.702937 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9a4d9209-53f8-4aea-9a74-d47f59facca5 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:38.710483 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9a4d9209-53f8-4aea-9a74-d47f59facca5 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1577 microversion: 2.1 time: 0.154321 Jun 16 15:11:38.711062 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 708/1405] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:38 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:39.727678 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1050d088-4c98-4346-bc00-805b4df0877c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:39.728246 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1050d088-4c98-4346-bc00-805b4df0877c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:39.734822 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1050d088-4c98-4346-bc00-805b4df0877c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:39.735366 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1050d088-4c98-4346-bc00-805b4df0877c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:39.736215 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1050d088-4c98-4346-bc00-805b4df0877c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:39.736681 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1050d088-4c98-4346-bc00-805b4df0877c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:39.868531 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1050d088-4c98-4346-bc00-805b4df0877c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:39.876583 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1050d088-4c98-4346-bc00-805b4df0877c tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1577 microversion: 2.1 time: 0.152808 Jun 16 15:11:39.877174 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 698/1406] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:39 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:40.894326 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6922f222-255a-47da-8036-56c2ae6805aa tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:40.894941 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6922f222-255a-47da-8036-56c2ae6805aa tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:40.902291 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6922f222-255a-47da-8036-56c2ae6805aa tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:40.902744 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6922f222-255a-47da-8036-56c2ae6805aa tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:40.903511 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6922f222-255a-47da-8036-56c2ae6805aa tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:40.903952 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6922f222-255a-47da-8036-56c2ae6805aa tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:41.034582 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6922f222-255a-47da-8036-56c2ae6805aa tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:41.042280 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6922f222-255a-47da-8036-56c2ae6805aa tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1577 microversion: 2.1 time: 0.151882 Jun 16 15:11:41.042836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 709/1407] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:40 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:42.059359 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-631df6a7-396d-460a-bcbc-3ba27e139840 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:42.059929 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-631df6a7-396d-460a-bcbc-3ba27e139840 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:42.066435 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-631df6a7-396d-460a-bcbc-3ba27e139840 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:42.066878 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-631df6a7-396d-460a-bcbc-3ba27e139840 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:42.067637 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-631df6a7-396d-460a-bcbc-3ba27e139840 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:42.068070 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-631df6a7-396d-460a-bcbc-3ba27e139840 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:42.204940 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-631df6a7-396d-460a-bcbc-3ba27e139840 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:42.213278 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-631df6a7-396d-460a-bcbc-3ba27e139840 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1577 microversion: 2.1 time: 0.157890 Jun 16 15:11:42.213839 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 699/1408] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:42 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:43.230899 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1e155336-f634-4037-a7d5-325bfcdf1d50 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:43.231515 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1e155336-f634-4037-a7d5-325bfcdf1d50 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:43.238098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e155336-f634-4037-a7d5-325bfcdf1d50 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:43.238552 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e155336-f634-4037-a7d5-325bfcdf1d50 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:43.239310 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e155336-f634-4037-a7d5-325bfcdf1d50 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:43.239748 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e155336-f634-4037-a7d5-325bfcdf1d50 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:43.378611 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1e155336-f634-4037-a7d5-325bfcdf1d50 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:43.386584 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1e155336-f634-4037-a7d5-325bfcdf1d50 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1577 microversion: 2.1 time: 0.159510 Jun 16 15:11:43.387148 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 710/1409] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:43 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:43.835930 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-01d16463-6def-4a43-a402-22cdb8f4b67d req-1342c02c-c922-4898-b96e-87e6c196d803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781db76b-7a5f-47b1-8272-b4868d68c437", "name": "network-vif-plugged", "status": "completed", "tag": "328671dd-12a3-45cf-9250-1f0f36195bba"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:11:43.845160 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-01d16463-6def-4a43-a402-22cdb8f4b67d req-1342c02c-c922-4898-b96e-87e6c196d803 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:43.845627 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-01d16463-6def-4a43-a402-22cdb8f4b67d req-1342c02c-c922-4898-b96e-87e6c196d803 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:43.858018 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-01d16463-6def-4a43-a402-22cdb8f4b67d req-1342c02c-c922-4898-b96e-87e6c196d803 service nova] Creating event network-vif-plugged:328671dd-12a3-45cf-9250-1f0f36195bba for instance 781db76b-7a5f-47b1-8272-b4868d68c437 on hv-cinder-83716 Jun 16 15:11:43.863033 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-01d16463-6def-4a43-a402-22cdb8f4b67d req-1342c02c-c922-4898-b96e-87e6c196d803 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031621 Jun 16 15:11:43.863626 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 700/1410] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:11:44.403963 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9588ba87-63a5-41d4-90e9-ad5b281b2aea tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:44.404614 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9588ba87-63a5-41d4-90e9-ad5b281b2aea tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:44.411253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9588ba87-63a5-41d4-90e9-ad5b281b2aea tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:44.411707 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9588ba87-63a5-41d4-90e9-ad5b281b2aea tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:44.412475 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9588ba87-63a5-41d4-90e9-ad5b281b2aea tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:44.412937 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9588ba87-63a5-41d4-90e9-ad5b281b2aea tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:44.548504 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9588ba87-63a5-41d4-90e9-ad5b281b2aea tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:44.556810 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9588ba87-63a5-41d4-90e9-ad5b281b2aea tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1577 microversion: 2.1 time: 0.156835 Jun 16 15:11:44.557403 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 711/1411] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:44 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:11:45.575941 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b3fad8d9-dbbf-46b2-a1de-acd7b2f7e9d4 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:45.576641 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b3fad8d9-dbbf-46b2-a1de-acd7b2f7e9d4 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:45.582957 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3fad8d9-dbbf-46b2-a1de-acd7b2f7e9d4 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:45.583406 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3fad8d9-dbbf-46b2-a1de-acd7b2f7e9d4 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:45.584173 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3fad8d9-dbbf-46b2-a1de-acd7b2f7e9d4 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:45.584611 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3fad8d9-dbbf-46b2-a1de-acd7b2f7e9d4 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:45.721465 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b3fad8d9-dbbf-46b2-a1de-acd7b2f7e9d4 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:45.729239 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b3fad8d9-dbbf-46b2-a1de-acd7b2f7e9d4 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1577 microversion: 2.1 time: 0.158203 Jun 16 15:11:45.729807 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 701/1412] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:45 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:11:46.745372 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7329cc4a-dc3d-4a1f-a786-0c8820ecf4d2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:11:46.745993 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7329cc4a-dc3d-4a1f-a786-0c8820ecf4d2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:11:46.752404 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7329cc4a-dc3d-4a1f-a786-0c8820ecf4d2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:46.752864 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7329cc4a-dc3d-4a1f-a786-0c8820ecf4d2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:46.753646 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7329cc4a-dc3d-4a1f-a786-0c8820ecf4d2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:11:46.754087 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7329cc4a-dc3d-4a1f-a786-0c8820ecf4d2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:11:46.887273 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7329cc4a-dc3d-4a1f-a786-0c8820ecf4d2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:11:46.895185 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7329cc4a-dc3d-4a1f-a786-0c8820ecf4d2 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1564 microversion: 2.1 time: 0.153562 Jun 16 15:11:46.895743 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 712/1413] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:11:46 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:12:00.375180 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5f7cf9c1-8f75-4d04-8c8e-5a3da01f9bb2 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d751b51-04eb-4523-8c5f-6f0146e906a2", "device": "/dev/sdb"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:12:00.376734 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5f7cf9c1-8f75-4d04-8c8e-5a3da01f9bb2 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:00.378873 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=11 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:12:00.379531 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:12:00.385479 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f7cf9c1-8f75-4d04-8c8e-5a3da01f9bb2 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:00.385929 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f7cf9c1-8f75-4d04-8c8e-5a3da01f9bb2 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:00.386692 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f7cf9c1-8f75-4d04-8c8e-5a3da01f9bb2 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:00.387132 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f7cf9c1-8f75-4d04-8c8e-5a3da01f9bb2 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:00.647987 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5f7cf9c1-8f75-4d04-8c8e-5a3da01f9bb2 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "POST /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276667 Jun 16 15:12:00.648549 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 702/1414] 10.222.0.72 () {60 vars in 1322 bytes} [Thu Jun 16 15:12:00 2022] POST /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:12:17.366942 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:12:17.367626 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Thu Jun 16 15:12:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:12:27.352832 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-864b37aa-caf4-4996-94a0-20c84a08febd tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:12:27.353377 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-864b37aa-caf4-4996-94a0-20c84a08febd tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:27.355416 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=11 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:12:27.356192 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=76 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:12:27.361836 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-864b37aa-caf4-4996-94a0-20c84a08febd tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:27.362291 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-864b37aa-caf4-4996-94a0-20c84a08febd tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:27.363055 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-864b37aa-caf4-4996-94a0-20c84a08febd tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:27.363500 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-864b37aa-caf4-4996-94a0-20c84a08febd tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:27.647243 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-864b37aa-caf4-4996-94a0-20c84a08febd tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lazy-loading 'services' on Instance uuid 69bb93ad-c721-4619-8402-14d8ca3a7d2d {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:12:27.716679 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-864b37aa-caf4-4996-94a0-20c84a08febd tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "DELETE /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d/os-volume_attachments/2d751b51-04eb-4523-8c5f-6f0146e906a2" status: 202 len: 0 microversion: 2.1 time: 0.367665 Jun 16 15:12:27.717290 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 713/1415] 10.222.0.72 () {58 vars in 1415 bytes} [Thu Jun 16 15:12:27 2022] DELETE /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d/os-volume_attachments/2d751b51-04eb-4523-8c5f-6f0146e906a2 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:12:28.835563 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:12:28.836331 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:12:28.840377 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9b2541d3-d0ee-4d00-8888-74ba5f5e99fb tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:12:28.840996 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9b2541d3-d0ee-4d00-8888-74ba5f5e99fb tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:28.848649 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b2541d3-d0ee-4d00-8888-74ba5f5e99fb tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:28.849143 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b2541d3-d0ee-4d00-8888-74ba5f5e99fb tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:28.849950 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b2541d3-d0ee-4d00-8888-74ba5f5e99fb tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:28.851054 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b2541d3-d0ee-4d00-8888-74ba5f5e99fb tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:28.875919 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9b2541d3-d0ee-4d00-8888-74ba5f5e99fb tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:12:28.950572 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9b2541d3-d0ee-4d00-8888-74ba5f5e99fb tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "DELETE /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 204 len: 0 microversion: 2.1 time: 0.116668 Jun 16 15:12:28.951185 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 703/1416] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:12:28 2022] DELETE /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 15:12:28.961100 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8c8a2477-10cc-4388-98ea-5186e5430791 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:12:28.961793 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8c8a2477-10cc-4388-98ea-5186e5430791 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:28.968051 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c8a2477-10cc-4388-98ea-5186e5430791 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:28.968500 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c8a2477-10cc-4388-98ea-5186e5430791 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:28.969329 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c8a2477-10cc-4388-98ea-5186e5430791 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:28.969766 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c8a2477-10cc-4388-98ea-5186e5430791 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:29.098068 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8c8a2477-10cc-4388-98ea-5186e5430791 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:12:29.105711 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8c8a2477-10cc-4388-98ea-5186e5430791 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 200 len: 1514 microversion: 2.1 time: 0.149968 Jun 16 15:12:29.106274 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 714/1417] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:12:28 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:12:30.123640 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1f63d589-0af4-4405-a9a4-b6396b50ad25 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:12:30.124348 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1f63d589-0af4-4405-a9a4-b6396b50ad25 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:30.130806 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1f63d589-0af4-4405-a9a4-b6396b50ad25 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:30.131314 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1f63d589-0af4-4405-a9a4-b6396b50ad25 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:30.132331 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1f63d589-0af4-4405-a9a4-b6396b50ad25 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:30.132958 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1f63d589-0af4-4405-a9a4-b6396b50ad25 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:30.361148 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1f63d589-0af4-4405-a9a4-b6396b50ad25 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:12:30.369632 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1f63d589-0af4-4405-a9a4-b6396b50ad25 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 200 len: 1514 microversion: 2.1 time: 0.250231 Jun 16 15:12:30.370200 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 704/1418] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:12:30 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 1514 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:12:31.253524 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-cd1b8c2c-bf6d-4737-a1dd-0b0fd3786092 req-75768f9d-5265-4936-b3f7-ec0435f14b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bb93ad-c721-4619-8402-14d8ca3a7d2d", "name": "network-vif-deleted", "tag": "a6ceb248-35be-4c1a-9d9a-18fd3d01c966"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:12:31.263297 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-cd1b8c2c-bf6d-4737-a1dd-0b0fd3786092 req-75768f9d-5265-4936-b3f7-ec0435f14b67 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:31.263739 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-cd1b8c2c-bf6d-4737-a1dd-0b0fd3786092 req-75768f9d-5265-4936-b3f7-ec0435f14b67 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:31.274987 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-cd1b8c2c-bf6d-4737-a1dd-0b0fd3786092 req-75768f9d-5265-4936-b3f7-ec0435f14b67 service nova] Creating event network-vif-deleted:a6ceb248-35be-4c1a-9d9a-18fd3d01c966 for instance 69bb93ad-c721-4619-8402-14d8ca3a7d2d on hv-cinder-83716 Jun 16 15:12:31.280901 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-cd1b8c2c-bf6d-4737-a1dd-0b0fd3786092 req-75768f9d-5265-4936-b3f7-ec0435f14b67 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030903 Jun 16 15:12:31.281490 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 715/1419] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:12:31.387764 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f9fd208b-68bf-4123-a871-0f2ed8fd3051 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:12:31.388384 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f9fd208b-68bf-4123-a871-0f2ed8fd3051 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:31.394904 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f9fd208b-68bf-4123-a871-0f2ed8fd3051 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:31.395366 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f9fd208b-68bf-4123-a871-0f2ed8fd3051 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:31.396138 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f9fd208b-68bf-4123-a871-0f2ed8fd3051 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:31.396586 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f9fd208b-68bf-4123-a871-0f2ed8fd3051 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:31.431307 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f9fd208b-68bf-4123-a871-0f2ed8fd3051 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:31.431663 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f9fd208b-68bf-4123-a871-0f2ed8fd3051 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:31.432107 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-f9fd208b-68bf-4123-a871-0f2ed8fd3051 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lazy-loading 'fault' on Instance uuid 69bb93ad-c721-4619-8402-14d8ca3a7d2d {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:12:31.474691 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f9fd208b-68bf-4123-a871-0f2ed8fd3051 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:12:31.482506 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f9fd208b-68bf-4123-a871-0f2ed8fd3051 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 200 len: 1309 microversion: 2.1 time: 0.098627 Jun 16 15:12:31.483082 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 705/1420] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:12:31 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:12:32.500541 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a885aa05-605c-441f-a43c-c3dc72eec233 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:12:32.501174 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a885aa05-605c-441f-a43c-c3dc72eec233 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 69bb93ad-c721-4619-8402-14d8ca3a7d2d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:32.507410 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a885aa05-605c-441f-a43c-c3dc72eec233 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:32.507854 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a885aa05-605c-441f-a43c-c3dc72eec233 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:32.508595 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a885aa05-605c-441f-a43c-c3dc72eec233 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:32.509061 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a885aa05-605c-441f-a43c-c3dc72eec233 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:32.521996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-a885aa05-605c-441f-a43c-c3dc72eec233 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] HTTP exception thrown: Instance 69bb93ad-c721-4619-8402-14d8ca3a7d2d could not be found. Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a885aa05-605c-441f-a43c-c3dc72eec233 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Request method failure captured: Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d HTTP/1.1 Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept: application/json Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Connection: close Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Length: 0 Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Content-Type: application/json Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Host: 10.222.0.72 Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABiq0gUDEVHQUoQHy3tAv1V2vQSIT7cFvl7rMYkrR67yO-VHw4kksYtBYh3xhsgzqUflr9G_Rei7DN4D7aIyfW-1xnkeCzfndRdNPkB3ib9qYpGY-it5aHu_2KD1WK3cFg109zpCSKcOB8Z73R49QkAGxwIdGfYPO2uZ1gSv_UbH8N4lhI Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Id: None Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Domain-Name: None Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Id: 4da5b37c95a342eaaa1aee173d381701 Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-VolumesSnapshotTestJSON-607798833 Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Role: member,reader Jun 16 15:12:32.523615 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Roles: member,reader Jun 16 15:12:32.525207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_4da5b37c95a342eaaa1aee173d381701", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4da5b37c95a342eaaa1aee173d381701"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4da5b37c95a342eaaa1aee173d381701"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/4da5b37c95a342eaaa1aee173d381701"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:12:32.525207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-VolumesSnapshotTestJSON-607798833 Jun 16 15:12:32.525207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 4da5b37c95a342eaaa1aee173d381701 Jun 16 15:12:32.525207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-607798833 Jun 16 15:12:32.525207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User: tempest-VolumesSnapshotTestJSON-607798833-project Jun 16 15:12:32.525207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default Jun 16 15:12:32.525207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default Jun 16 15:12:32.525207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Id: b952610adaa34e1b8c4d23433bd1558e Jun 16 15:12:32.525207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-VolumesSnapshotTestJSON-607798833-project Jun 16 15:12:32.525207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: method: > Jun 16 15:12:32.525207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: exception: Instance 69bb93ad-c721-4619-8402-14d8ca3a7d2d could not be found. Jun 16 15:12:32.525207 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: action_args: {'id': '69bb93ad-c721-4619-8402-14d8ca3a7d2d'} Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69bb93ad-c721-4619-8402-14d8ca3a7d2d could not be found. Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:12:32.526152 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:12:32.527869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:12:32.527869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:12:32.527869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:12:32.527869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:12:32.527869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:12:32.527869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:12:32.527869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:12:32.527869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69bb93ad-c721-4619-8402-14d8ca3a7d2d could not be found. Jun 16 15:12:32.527869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:12:32.527869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:12:32.527869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:12:32.527869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:12:32.527869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:12:32.527869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:12:32.527869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:12:32.527869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:12:32.527869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69bb93ad-c721-4619-8402-14d8ca3a7d2d could not be found. Jun 16 15:12:32.527869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Jun 16 15:12:32.530001 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a885aa05-605c-441f-a43c-c3dc72eec233 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Returning 404 to user: Instance 69bb93ad-c721-4619-8402-14d8ca3a7d2d could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:12:32.530001 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a885aa05-605c-441f-a43c-c3dc72eec233 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d" status: 404 len: 111 microversion: 2.1 time: 0.029226 Jun 16 15:12:32.530001 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 716/1421] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:12:32 2022] GET /compute/v2.1/servers/69bb93ad-c721-4619-8402-14d8ca3a7d2d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:12:42.372591 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-843c9ed2-1b7b-42a7-96e7-5ff84caa2053 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1677813317", "imageRef": "23371504-a4d6-4064-90b4-87bfd0a15170", "flavorRef": "452", "networks": [{"uuid": "78b26139-d9a4-4f35-bf86-6e837f876733"}]}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:12:42.379935 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:12:42.380726 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:12:42.427524 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-843c9ed2-1b7b-42a7-96e7-5ff84caa2053 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] validate_networks() for [('78b26139-d9a4-4f35-bf86-6e837f876733', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 15:12:42.762351 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-843c9ed2-1b7b-42a7-96e7-5ff84caa2053 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 15:12:42.762782 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-843c9ed2-1b7b-42a7-96e7-5ff84caa2053 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 15:12:42.763288 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-843c9ed2-1b7b-42a7-96e7-5ff84caa2053 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 15:12:42.763699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-843c9ed2-1b7b-42a7-96e7-5ff84caa2053 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 15:12:42.764119 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-843c9ed2-1b7b-42a7-96e7-5ff84caa2053 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 15:12:42.772799 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-843c9ed2-1b7b-42a7-96e7-5ff84caa2053 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:42.773282 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-843c9ed2-1b7b-42a7-96e7-5ff84caa2053 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:42.774077 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-843c9ed2-1b7b-42a7-96e7-5ff84caa2053 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:42.774515 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-843c9ed2-1b7b-42a7-96e7-5ff84caa2053 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:42.791636 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-843c9ed2-1b7b-42a7-96e7-5ff84caa2053 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Getting quotas for project 4da5b37c95a342eaaa1aee173d381701. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 15:12:42.795500 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-843c9ed2-1b7b-42a7-96e7-5ff84caa2053 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Getting quotas for user b952610adaa34e1b8c4d23433bd1558e and project 4da5b37c95a342eaaa1aee173d381701. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 15:12:42.806648 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-843c9ed2-1b7b-42a7-96e7-5ff84caa2053 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 15:12:42.808908 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-843c9ed2-1b7b-42a7-96e7-5ff84caa2053 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='23371504-a4d6-4064-90b4-87bfd0a15170',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 15:12:42.852893 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-843c9ed2-1b7b-42a7-96e7-5ff84caa2053 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.484215 Jun 16 15:12:42.853544 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 706/1422] 10.222.0.72 () {60 vars in 1146 bytes} [Thu Jun 16 15:12:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 15:12:42.863438 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ef1681fb-1541-4031-93ff-30df2afcd255 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:12:42.864095 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ef1681fb-1541-4031-93ff-30df2afcd255 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:42.866723 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=8 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:12:42.867366 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:12:42.921748 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ef1681fb-1541-4031-93ff-30df2afcd255 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:12:42.929205 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ef1681fb-1541-4031-93ff-30df2afcd255 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a" status: 200 len: 1219 microversion: 2.1 time: 0.069129 Jun 16 15:12:42.929754 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 717/1423] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:12:42 2022] GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:12:43.945498 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-40f40ff1-1d99-4e2e-8870-88f8aafb7c20 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:12:43.946387 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-40f40ff1-1d99-4e2e-8870-88f8aafb7c20 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:43.953246 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-40f40ff1-1d99-4e2e-8870-88f8aafb7c20 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:43.953709 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-40f40ff1-1d99-4e2e-8870-88f8aafb7c20 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:43.954495 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-40f40ff1-1d99-4e2e-8870-88f8aafb7c20 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:43.954944 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-40f40ff1-1d99-4e2e-8870-88f8aafb7c20 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:44.035957 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-40f40ff1-1d99-4e2e-8870-88f8aafb7c20 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:12:44.044880 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-40f40ff1-1d99-4e2e-8870-88f8aafb7c20 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a" status: 200 len: 1279 microversion: 2.1 time: 0.103191 Jun 16 15:12:44.045463 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 707/1424] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:12:43 2022] GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a => generated 1279 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:12:45.061959 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-23eaaf31-ec31-4ea2-b163-3b7850a3f078 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:12:45.062592 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-23eaaf31-ec31-4ea2-b163-3b7850a3f078 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:45.070888 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-23eaaf31-ec31-4ea2-b163-3b7850a3f078 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:45.071338 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-23eaaf31-ec31-4ea2-b163-3b7850a3f078 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:45.072098 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-23eaaf31-ec31-4ea2-b163-3b7850a3f078 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:45.072529 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-23eaaf31-ec31-4ea2-b163-3b7850a3f078 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:45.202916 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-23eaaf31-ec31-4ea2-b163-3b7850a3f078 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:12:45.210536 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-23eaaf31-ec31-4ea2-b163-3b7850a3f078 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a" status: 200 len: 1319 microversion: 2.1 time: 0.152415 Jun 16 15:12:45.211070 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 718/1425] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:12:45 2022] GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:12:45.642519 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-2df91ac4-c498-493a-8cd9-6c8cdb5c6d25 req-070963e1-6e03-4e11-b316-cf1cd3f70044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449d95c7-5764-4888-b81c-5938a334a38a", "tag": "aeb47bdf-b9fb-4881-a503-f11f7485ad0a"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:12:45.652676 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-2df91ac4-c498-493a-8cd9-6c8cdb5c6d25 req-070963e1-6e03-4e11-b316-cf1cd3f70044 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:45.653825 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-2df91ac4-c498-493a-8cd9-6c8cdb5c6d25 req-070963e1-6e03-4e11-b316-cf1cd3f70044 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:45.666536 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-2df91ac4-c498-493a-8cd9-6c8cdb5c6d25 req-070963e1-6e03-4e11-b316-cf1cd3f70044 service nova] Creating event network-changed:aeb47bdf-b9fb-4881-a503-f11f7485ad0a for instance 449d95c7-5764-4888-b81c-5938a334a38a on hv-cinder-83716 Jun 16 15:12:45.672206 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-2df91ac4-c498-493a-8cd9-6c8cdb5c6d25 req-070963e1-6e03-4e11-b316-cf1cd3f70044 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034063 Jun 16 15:12:45.672877 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 708/1426] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:12:46.226842 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b915f948-1b88-4c8d-a7d1-91e5a3eda49e tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:12:46.227382 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b915f948-1b88-4c8d-a7d1-91e5a3eda49e tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:46.233865 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b915f948-1b88-4c8d-a7d1-91e5a3eda49e tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:46.234296 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b915f948-1b88-4c8d-a7d1-91e5a3eda49e tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:46.235073 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b915f948-1b88-4c8d-a7d1-91e5a3eda49e tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:46.235505 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b915f948-1b88-4c8d-a7d1-91e5a3eda49e tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:46.361495 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b915f948-1b88-4c8d-a7d1-91e5a3eda49e tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:12:46.369624 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b915f948-1b88-4c8d-a7d1-91e5a3eda49e tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a" status: 200 len: 1319 microversion: 2.1 time: 0.146727 Jun 16 15:12:46.370180 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 719/1427] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:12:46 2022] GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:12:47.387134 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e8482355-b0b8-40d5-9fab-1a574812f716 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:12:47.387831 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e8482355-b0b8-40d5-9fab-1a574812f716 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:47.394516 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e8482355-b0b8-40d5-9fab-1a574812f716 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:47.394971 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e8482355-b0b8-40d5-9fab-1a574812f716 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:47.395724 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e8482355-b0b8-40d5-9fab-1a574812f716 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:47.396157 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e8482355-b0b8-40d5-9fab-1a574812f716 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:47.526705 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e8482355-b0b8-40d5-9fab-1a574812f716 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:12:47.534143 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e8482355-b0b8-40d5-9fab-1a574812f716 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a" status: 200 len: 1319 microversion: 2.1 time: 0.151223 Jun 16 15:12:47.534955 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 709/1428] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:12:47 2022] GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:12:48.551535 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c29a9ee1-df0f-4733-bbc0-8c25f119c58b tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:12:48.552211 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c29a9ee1-df0f-4733-bbc0-8c25f119c58b tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:48.559181 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c29a9ee1-df0f-4733-bbc0-8c25f119c58b tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:48.559632 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c29a9ee1-df0f-4733-bbc0-8c25f119c58b tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:48.560426 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c29a9ee1-df0f-4733-bbc0-8c25f119c58b tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:48.560877 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c29a9ee1-df0f-4733-bbc0-8c25f119c58b tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:48.697422 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c29a9ee1-df0f-4733-bbc0-8c25f119c58b tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:12:48.704817 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c29a9ee1-df0f-4733-bbc0-8c25f119c58b tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a" status: 200 len: 1319 microversion: 2.1 time: 0.157214 Jun 16 15:12:48.705437 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 720/1429] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:12:48 2022] GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:12:49.722130 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-41e29ec3-0dfc-4ca7-935b-14539fea0756 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:12:49.722744 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-41e29ec3-0dfc-4ca7-935b-14539fea0756 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:49.729851 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-41e29ec3-0dfc-4ca7-935b-14539fea0756 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:49.730312 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-41e29ec3-0dfc-4ca7-935b-14539fea0756 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:49.731075 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-41e29ec3-0dfc-4ca7-935b-14539fea0756 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:49.731521 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-41e29ec3-0dfc-4ca7-935b-14539fea0756 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:49.865336 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-41e29ec3-0dfc-4ca7-935b-14539fea0756 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:12:49.873347 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-41e29ec3-0dfc-4ca7-935b-14539fea0756 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a" status: 200 len: 1319 microversion: 2.1 time: 0.155141 Jun 16 15:12:49.873925 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 710/1430] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:12:49 2022] GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:12:50.890332 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b9f8d71d-37b3-4a38-b4e4-d5e5e38f6120 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:12:50.890944 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b9f8d71d-37b3-4a38-b4e4-d5e5e38f6120 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:50.899067 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b9f8d71d-37b3-4a38-b4e4-d5e5e38f6120 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:50.899516 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b9f8d71d-37b3-4a38-b4e4-d5e5e38f6120 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:50.900269 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b9f8d71d-37b3-4a38-b4e4-d5e5e38f6120 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:50.900699 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b9f8d71d-37b3-4a38-b4e4-d5e5e38f6120 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:51.027626 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b9f8d71d-37b3-4a38-b4e4-d5e5e38f6120 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:12:51.035196 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b9f8d71d-37b3-4a38-b4e4-d5e5e38f6120 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a" status: 200 len: 1319 microversion: 2.1 time: 0.148462 Jun 16 15:12:51.035747 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 721/1431] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:12:50 2022] GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:12:52.052582 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0a651355-d322-4378-80ab-b074929ad1a9 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:12:52.053268 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0a651355-d322-4378-80ab-b074929ad1a9 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:52.059805 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0a651355-d322-4378-80ab-b074929ad1a9 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:52.060282 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0a651355-d322-4378-80ab-b074929ad1a9 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:52.061097 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0a651355-d322-4378-80ab-b074929ad1a9 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:52.061537 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0a651355-d322-4378-80ab-b074929ad1a9 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:52.190901 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0a651355-d322-4378-80ab-b074929ad1a9 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:12:52.198939 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0a651355-d322-4378-80ab-b074929ad1a9 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a" status: 200 len: 1319 microversion: 2.1 time: 0.150182 Jun 16 15:12:52.199490 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 711/1432] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:12:52 2022] GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:12:52.578240 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-d8ff849e-ff62-4e17-8b41-7a5c746ca670 req-bd97c7d0-80f4-4938-8ad8-e6f6029e83d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449d95c7-5764-4888-b81c-5938a334a38a", "name": "network-vif-plugged", "status": "completed", "tag": "aeb47bdf-b9fb-4881-a503-f11f7485ad0a"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:12:52.587072 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-d8ff849e-ff62-4e17-8b41-7a5c746ca670 req-bd97c7d0-80f4-4938-8ad8-e6f6029e83d1 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:52.587472 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-d8ff849e-ff62-4e17-8b41-7a5c746ca670 req-bd97c7d0-80f4-4938-8ad8-e6f6029e83d1 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:52.599404 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-d8ff849e-ff62-4e17-8b41-7a5c746ca670 req-bd97c7d0-80f4-4938-8ad8-e6f6029e83d1 service nova] Creating event network-vif-plugged:aeb47bdf-b9fb-4881-a503-f11f7485ad0a for instance 449d95c7-5764-4888-b81c-5938a334a38a on hv-cinder-83716 Jun 16 15:12:52.604917 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-d8ff849e-ff62-4e17-8b41-7a5c746ca670 req-bd97c7d0-80f4-4938-8ad8-e6f6029e83d1 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030373 Jun 16 15:12:52.605517 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 722/1433] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:12:53.215353 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c8876313-cc9c-4195-8321-43edc837d815 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:12:53.215969 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c8876313-cc9c-4195-8321-43edc837d815 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:53.218009 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:12:53.218708 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=6 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:12:53.225506 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8876313-cc9c-4195-8321-43edc837d815 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:53.225962 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8876313-cc9c-4195-8321-43edc837d815 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:53.226733 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8876313-cc9c-4195-8321-43edc837d815 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:53.227175 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8876313-cc9c-4195-8321-43edc837d815 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:53.356540 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c8876313-cc9c-4195-8321-43edc837d815 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:12:53.364120 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c8876313-cc9c-4195-8321-43edc837d815 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a" status: 200 len: 1319 microversion: 2.1 time: 0.152546 Jun 16 15:12:53.364674 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 712/1434] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:12:53 2022] GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:12:54.379021 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:12:54.384079 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5151bdeb-308b-4fa7-9fd1-afc7dff21f25 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:12:54.384768 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5151bdeb-308b-4fa7-9fd1-afc7dff21f25 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:54.391244 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5151bdeb-308b-4fa7-9fd1-afc7dff21f25 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:54.391694 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5151bdeb-308b-4fa7-9fd1-afc7dff21f25 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:54.392519 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5151bdeb-308b-4fa7-9fd1-afc7dff21f25 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:54.392939 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5151bdeb-308b-4fa7-9fd1-afc7dff21f25 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:54.522063 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5151bdeb-308b-4fa7-9fd1-afc7dff21f25 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:12:54.529549 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5151bdeb-308b-4fa7-9fd1-afc7dff21f25 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a" status: 200 len: 1319 microversion: 2.1 time: 0.151532 Jun 16 15:12:54.530103 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 723/1435] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:12:54 2022] GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:12:55.546746 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-66362600-fae7-47a9-b569-5808e5d3daf3 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:12:55.547367 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-66362600-fae7-47a9-b569-5808e5d3daf3 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:55.553713 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-66362600-fae7-47a9-b569-5808e5d3daf3 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:55.554171 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-66362600-fae7-47a9-b569-5808e5d3daf3 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:55.554931 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-66362600-fae7-47a9-b569-5808e5d3daf3 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:55.555374 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-66362600-fae7-47a9-b569-5808e5d3daf3 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:55.682191 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-66362600-fae7-47a9-b569-5808e5d3daf3 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:12:55.690034 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-66362600-fae7-47a9-b569-5808e5d3daf3 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a" status: 200 len: 1507 microversion: 2.1 time: 0.147181 Jun 16 15:12:55.690631 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 713/1436] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:12:55 2022] GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:12:55.706837 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8743277f-a4f3-42c5-af52-ffce4c20012d tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55c6bc5c-6818-4dc7-a3e7-eb2e186176d5", "device": "/dev/sdb"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:12:55.708400 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8743277f-a4f3-42c5-af52-ffce4c20012d tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:12:55.715522 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8743277f-a4f3-42c5-af52-ffce4c20012d tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:55.715974 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8743277f-a4f3-42c5-af52-ffce4c20012d tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:55.716734 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8743277f-a4f3-42c5-af52-ffce4c20012d tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:12:55.717201 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8743277f-a4f3-42c5-af52-ffce4c20012d tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:12:55.955045 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8743277f-a4f3-42c5-af52-ffce4c20012d tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "POST /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251819 Jun 16 15:12:55.958347 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 724/1437] 10.222.0.72 () {60 vars in 1322 bytes} [Thu Jun 16 15:12:55 2022] POST /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:13:17.290789 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f581a683-5975-49d9-abf8-ad21f4e3e835 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:17.291327 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f581a683-5975-49d9-abf8-ad21f4e3e835 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:17.293899 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:17.294564 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=40 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:17.300617 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f581a683-5975-49d9-abf8-ad21f4e3e835 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:17.301103 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f581a683-5975-49d9-abf8-ad21f4e3e835 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:17.301889 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f581a683-5975-49d9-abf8-ad21f4e3e835 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:17.302319 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f581a683-5975-49d9-abf8-ad21f4e3e835 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:17.382021 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-f581a683-5975-49d9-abf8-ad21f4e3e835 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lazy-loading 'services' on Instance uuid 449d95c7-5764-4888-b81c-5938a334a38a {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 15:13:17.452268 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f581a683-5975-49d9-abf8-ad21f4e3e835 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "DELETE /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a/os-volume_attachments/55c6bc5c-6818-4dc7-a3e7-eb2e186176d5" status: 202 len: 0 microversion: 2.1 time: 0.165849 Jun 16 15:13:17.452869 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 714/1438] 10.222.0.72 () {58 vars in 1415 bytes} [Thu Jun 16 15:13:17 2022] DELETE /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a/os-volume_attachments/55c6bc5c-6818-4dc7-a3e7-eb2e186176d5 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:13:18.570566 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=18 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:18.571324 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:18.575345 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a8a8db83-8ab0-4e4f-8500-e779dfd4aaa5 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:18.575921 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a8a8db83-8ab0-4e4f-8500-e779dfd4aaa5 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:18.583131 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a8a8db83-8ab0-4e4f-8500-e779dfd4aaa5 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:18.583580 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a8a8db83-8ab0-4e4f-8500-e779dfd4aaa5 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:18.584329 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a8a8db83-8ab0-4e4f-8500-e779dfd4aaa5 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:18.584761 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a8a8db83-8ab0-4e4f-8500-e779dfd4aaa5 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:18.611124 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a8a8db83-8ab0-4e4f-8500-e779dfd4aaa5 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:13:18.685134 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a8a8db83-8ab0-4e4f-8500-e779dfd4aaa5 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "DELETE /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a" status: 204 len: 0 microversion: 2.1 time: 0.115871 Jun 16 15:13:18.685998 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 725/1439] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:13:18 2022] DELETE /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:13:18.696226 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1a180daa-4b81-4fd6-b8fa-e0da300b7630 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:18.696959 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1a180daa-4b81-4fd6-b8fa-e0da300b7630 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:18.703241 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1a180daa-4b81-4fd6-b8fa-e0da300b7630 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:18.703699 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1a180daa-4b81-4fd6-b8fa-e0da300b7630 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:18.704466 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1a180daa-4b81-4fd6-b8fa-e0da300b7630 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:18.704937 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1a180daa-4b81-4fd6-b8fa-e0da300b7630 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:18.836697 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1a180daa-4b81-4fd6-b8fa-e0da300b7630 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:18.844125 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1a180daa-4b81-4fd6-b8fa-e0da300b7630 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a" status: 200 len: 1513 microversion: 2.1 time: 0.153440 Jun 16 15:13:18.844878 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 715/1440] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:18 2022] GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 15:13:19.862738 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-795ef4d9-b7de-4740-a59a-fef1cda4cb9c tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:19.863441 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-795ef4d9-b7de-4740-a59a-fef1cda4cb9c tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:19.870795 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-795ef4d9-b7de-4740-a59a-fef1cda4cb9c tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:19.871250 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-795ef4d9-b7de-4740-a59a-fef1cda4cb9c tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:19.872013 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-795ef4d9-b7de-4740-a59a-fef1cda4cb9c tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:19.872460 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-795ef4d9-b7de-4740-a59a-fef1cda4cb9c tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:20.004354 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-795ef4d9-b7de-4740-a59a-fef1cda4cb9c tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:20.011911 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-795ef4d9-b7de-4740-a59a-fef1cda4cb9c tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a" status: 200 len: 1513 microversion: 2.1 time: 0.153515 Jun 16 15:13:20.012476 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 726/1441] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:19 2022] GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:21.029503 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c8698d7c-bab3-433c-aaa9-0ace5edfb902 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:21.030171 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c8698d7c-bab3-433c-aaa9-0ace5edfb902 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:21.036820 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8698d7c-bab3-433c-aaa9-0ace5edfb902 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:21.037301 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8698d7c-bab3-433c-aaa9-0ace5edfb902 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:21.038066 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8698d7c-bab3-433c-aaa9-0ace5edfb902 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:21.038505 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8698d7c-bab3-433c-aaa9-0ace5edfb902 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:21.237633 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c8698d7c-bab3-433c-aaa9-0ace5edfb902 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b952610adaa34e1b8c4d23433bd1558e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da5b37c95a342eaaa1aee173d381701', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:21.245065 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c8698d7c-bab3-433c-aaa9-0ace5edfb902 tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a" status: 200 len: 1513 microversion: 2.1 time: 0.219415 Jun 16 15:13:21.245848 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 716/1442] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:21 2022] GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a => generated 1513 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:21.419678 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-3114440b-f148-4cb6-92f7-c1c05f5822a6 req-e9ee88fa-3650-46a6-8ea6-0441b937ce18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449d95c7-5764-4888-b81c-5938a334a38a", "name": "network-vif-deleted", "tag": "aeb47bdf-b9fb-4881-a503-f11f7485ad0a"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:13:21.430498 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-3114440b-f148-4cb6-92f7-c1c05f5822a6 req-e9ee88fa-3650-46a6-8ea6-0441b937ce18 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:21.431177 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-3114440b-f148-4cb6-92f7-c1c05f5822a6 req-e9ee88fa-3650-46a6-8ea6-0441b937ce18 service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:21.448120 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-3114440b-f148-4cb6-92f7-c1c05f5822a6 req-e9ee88fa-3650-46a6-8ea6-0441b937ce18 service nova] Creating event network-vif-deleted:aeb47bdf-b9fb-4881-a503-f11f7485ad0a for instance 449d95c7-5764-4888-b81c-5938a334a38a on hv-cinder-83716 Jun 16 15:13:21.454677 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-3114440b-f148-4cb6-92f7-c1c05f5822a6 req-e9ee88fa-3650-46a6-8ea6-0441b937ce18 service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039084 Jun 16 15:13:21.455650 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 727/1443] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:13:22.262751 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-654a141f-9585-471d-98ea-38507bf26c0a tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:22.263336 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-654a141f-9585-471d-98ea-38507bf26c0a tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] [instance: 449d95c7-5764-4888-b81c-5938a334a38a] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:22.270010 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-654a141f-9585-471d-98ea-38507bf26c0a tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:22.270462 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-654a141f-9585-471d-98ea-38507bf26c0a tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:22.271223 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-654a141f-9585-471d-98ea-38507bf26c0a tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:22.271660 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-654a141f-9585-471d-98ea-38507bf26c0a tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:22.284646 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-654a141f-9585-471d-98ea-38507bf26c0a tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] HTTP exception thrown: Instance 449d95c7-5764-4888-b81c-5938a334a38a could not be found. Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-654a141f-9585-471d-98ea-38507bf26c0a tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Request method failure captured: Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a HTTP/1.1 Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0gUDEVHQUoQHy3tAv1V2vQSIT7cFvl7rMYkrR67yO-VHw4kksYtBYh3xhsgzqUflr9G_Rei7DN4D7aIyfW-1xnkeCzfndRdNPkB3ib9qYpGY-it5aHu_2KD1WK3cFg109zpCSKcOB8Z73R49QkAGxwIdGfYPO2uZ1gSv_UbH8N4lhI Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 4da5b37c95a342eaaa1aee173d381701 Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-VolumesSnapshotTestJSON-607798833 Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:13:22.286559 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:13:22.288423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_4da5b37c95a342eaaa1aee173d381701", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4da5b37c95a342eaaa1aee173d381701"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/4da5b37c95a342eaaa1aee173d381701"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/4da5b37c95a342eaaa1aee173d381701"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:13:22.288423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-VolumesSnapshotTestJSON-607798833 Jun 16 15:13:22.288423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 4da5b37c95a342eaaa1aee173d381701 Jun 16 15:13:22.288423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-607798833 Jun 16 15:13:22.288423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-VolumesSnapshotTestJSON-607798833-project Jun 16 15:13:22.288423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:13:22.288423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:13:22.288423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: b952610adaa34e1b8c4d23433bd1558e Jun 16 15:13:22.288423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-VolumesSnapshotTestJSON-607798833-project Jun 16 15:13:22.288423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:13:22.288423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance 449d95c7-5764-4888-b81c-5938a334a38a could not be found. Jun 16 15:13:22.288423 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': '449d95c7-5764-4888-b81c-5938a334a38a'} Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449d95c7-5764-4888-b81c-5938a334a38a could not be found. Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:13:22.289599 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:13:22.291361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:13:22.291361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:13:22.291361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:13:22.291361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:13:22.291361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:13:22.291361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:13:22.291361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:13:22.291361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449d95c7-5764-4888-b81c-5938a334a38a could not be found. Jun 16 15:13:22.291361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:13:22.291361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:13:22.291361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:13:22.291361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:13:22.291361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:13:22.291361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:13:22.291361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:13:22.291361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:13:22.291361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449d95c7-5764-4888-b81c-5938a334a38a could not be found. Jun 16 15:13:22.291361 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:13:22.292987 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-654a141f-9585-471d-98ea-38507bf26c0a tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] Returning 404 to user: Instance 449d95c7-5764-4888-b81c-5938a334a38a could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:13:22.292987 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-654a141f-9585-471d-98ea-38507bf26c0a tempest-VolumesSnapshotTestJSON-607798833 tempest-VolumesSnapshotTestJSON-607798833-project] 10.222.0.72 "GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a" status: 404 len: 111 microversion: 2.1 time: 0.029166 Jun 16 15:13:22.292987 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 717/1444] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:22 2022] GET /compute/v2.1/servers/449d95c7-5764-4888-b81c-5938a334a38a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:13:55.192917 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-37ac62bf-6328-4291-a511-1f61a5a700b0 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:55.193503 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-37ac62bf-6328-4291-a511-1f61a5a700b0 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:55.194471 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-03b5a930-31b3-4062-85ac-30f8a4c59d9c req-490fb555-b12a-4e5a-8436-f8e79140daaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "781db76b-7a5f-47b1-8272-b4868d68c437", "tag": "328671dd-12a3-45cf-9250-1f0f36195bba"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:13:55.196121 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:55.197036 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:55.198976 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=8 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:55.199623 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 15:13:55.204956 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-03b5a930-31b3-4062-85ac-30f8a4c59d9c req-490fb555-b12a-4e5a-8436-f8e79140daaf service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:55.205403 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-03b5a930-31b3-4062-85ac-30f8a4c59d9c req-490fb555-b12a-4e5a-8436-f8e79140daaf service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:55.207113 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-37ac62bf-6328-4291-a511-1f61a5a700b0 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:55.207750 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-37ac62bf-6328-4291-a511-1f61a5a700b0 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:55.208596 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-37ac62bf-6328-4291-a511-1f61a5a700b0 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:55.209131 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-37ac62bf-6328-4291-a511-1f61a5a700b0 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:55.220031 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-03b5a930-31b3-4062-85ac-30f8a4c59d9c req-490fb555-b12a-4e5a-8436-f8e79140daaf service nova] Creating event network-changed:328671dd-12a3-45cf-9250-1f0f36195bba for instance 781db76b-7a5f-47b1-8272-b4868d68c437 on hv-cinder-83716 Jun 16 15:13:55.225248 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-03b5a930-31b3-4062-85ac-30f8a4c59d9c req-490fb555-b12a-4e5a-8436-f8e79140daaf service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034405 Jun 16 15:13:55.226110 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 718/1445] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:13:55.239985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-37ac62bf-6328-4291-a511-1f61a5a700b0 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 15:13:55.325691 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-37ac62bf-6328-4291-a511-1f61a5a700b0 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "DELETE /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 204 len: 0 microversion: 2.1 time: 0.137084 Jun 16 15:13:55.326564 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 728/1446] 10.222.0.72 () {58 vars in 1238 bytes} [Thu Jun 16 15:13:55 2022] DELETE /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 15:13:55.334993 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d2fd36ad-60e8-455b-b372-73403fd356a3 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:55.335771 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d2fd36ad-60e8-455b-b372-73403fd356a3 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:55.342692 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2fd36ad-60e8-455b-b372-73403fd356a3 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:55.343240 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2fd36ad-60e8-455b-b372-73403fd356a3 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:55.344079 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2fd36ad-60e8-455b-b372-73403fd356a3 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:55.344584 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2fd36ad-60e8-455b-b372-73403fd356a3 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:55.507781 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d2fd36ad-60e8-455b-b372-73403fd356a3 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:55.515949 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d2fd36ad-60e8-455b-b372-73403fd356a3 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.185147 Jun 16 15:13:55.516493 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 719/1447] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:55 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:56.536571 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-38ea2d2a-389c-4605-b27d-52eaef55fb22 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:56.537300 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-38ea2d2a-389c-4605-b27d-52eaef55fb22 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:56.544443 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-38ea2d2a-389c-4605-b27d-52eaef55fb22 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:56.544923 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-38ea2d2a-389c-4605-b27d-52eaef55fb22 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:56.545698 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-38ea2d2a-389c-4605-b27d-52eaef55fb22 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:56.546147 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-38ea2d2a-389c-4605-b27d-52eaef55fb22 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:56.680351 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-38ea2d2a-389c-4605-b27d-52eaef55fb22 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:56.687869 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-38ea2d2a-389c-4605-b27d-52eaef55fb22 tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1570 microversion: 2.1 time: 0.156421 Jun 16 15:13:56.688423 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 729/1448] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:56 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:57.615081 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-1d9261fb-4e91-4a2f-ae40-780c95ae5d01 req-43487955-7625-4ff6-9c46-77b85ae7826c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "781db76b-7a5f-47b1-8272-b4868d68c437", "name": "network-vif-deleted", "tag": "328671dd-12a3-45cf-9250-1f0f36195bba"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 15:13:57.624121 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-1d9261fb-4e91-4a2f-ae40-780c95ae5d01 req-43487955-7625-4ff6-9c46-77b85ae7826c service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:57.624670 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-1d9261fb-4e91-4a2f-ae40-780c95ae5d01 req-43487955-7625-4ff6-9c46-77b85ae7826c service nova] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:57.635840 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-1d9261fb-4e91-4a2f-ae40-780c95ae5d01 req-43487955-7625-4ff6-9c46-77b85ae7826c service nova] Creating event network-vif-deleted:328671dd-12a3-45cf-9250-1f0f36195bba for instance 781db76b-7a5f-47b1-8272-b4868d68c437 on hv-cinder-83716 Jun 16 15:13:57.641393 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-1d9261fb-4e91-4a2f-ae40-780c95ae5d01 req-43487955-7625-4ff6-9c46-77b85ae7826c service nova] 10.222.0.72 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029991 Jun 16 15:13:57.642079 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 720/1449] 10.222.0.72 () {64 vars in 1317 bytes} [Thu Jun 16 15:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 15:13:57.705116 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-43cc25b3-e45b-4015-8770-5006e41bc47d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:57.705751 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-43cc25b3-e45b-4015-8770-5006e41bc47d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:57.712589 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-43cc25b3-e45b-4015-8770-5006e41bc47d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:57.713712 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-43cc25b3-e45b-4015-8770-5006e41bc47d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:57.714613 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-43cc25b3-e45b-4015-8770-5006e41bc47d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:57.715020 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-43cc25b3-e45b-4015-8770-5006e41bc47d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:57.775518 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-43cc25b3-e45b-4015-8770-5006e41bc47d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e6fbab71db54b698572bb8a7d033063', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3716e192b1194365acb5595c8f92a862', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 15:13:57.783562 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-43cc25b3-e45b-4015-8770-5006e41bc47d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 200 len: 1220 microversion: 2.1 time: 0.082429 Jun 16 15:13:57.784131 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 730/1450] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:57 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 15:13:58.801763 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f340288c-00a3-4a1a-bc3c-2da9bc34f29d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:58.802467 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f340288c-00a3-4a1a-bc3c-2da9bc34f29d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] [instance: 781db76b-7a5f-47b1-8272-b4868d68c437] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 15:13:58.808679 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f340288c-00a3-4a1a-bc3c-2da9bc34f29d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:58.809167 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f340288c-00a3-4a1a-bc3c-2da9bc34f29d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:58.809959 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f340288c-00a3-4a1a-bc3c-2da9bc34f29d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 15:13:58.810401 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f340288c-00a3-4a1a-bc3c-2da9bc34f29d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Lock "5bf84c3a-2cb0-4224-8719-767e2c0696c7" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 15:13:58.823688 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-f340288c-00a3-4a1a-bc3c-2da9bc34f29d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] HTTP exception thrown: Instance 781db76b-7a5f-47b1-8272-b4868d68c437 could not be found. Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f340288c-00a3-4a1a-bc3c-2da9bc34f29d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Request method failure captured: Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 HTTP/1.1 Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept: application/json Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Connection: close Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Length: 0 Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Content-Type: application/json Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Host: 10.222.0.72 Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABiq0cS8bxqHVmR60PFUefecYS_a0i7Xj4aqw-8PKo36IjvWhStTz4LR50MSvcF-o3lfkdS_5vml6KHp3AUs_et2a_IT7Kr4ge0IZ9w131qbVxmcNM4clCmm8Kpt4Cu5ZO4SZfU0O-QbIQK7-yZGNJ3ctou9XoqZLaNokFLt2KO_981ioc Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Id: None Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Domain-Name: None Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Id: 3716e192b1194365acb5595c8f92a862 Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-TestShelveInstance-1074315081 Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Role: member,reader Jun 16 15:13:58.825315 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Roles: member,reader Jun 16 15:13:58.827123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:8080/v1/AUTH_3716e192b1194365acb5595c8f92a862", "adminURL": "http://10.222.0.72:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3716e192b1194365acb5595c8f92a862"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/volume/v3/3716e192b1194365acb5595c8f92a862"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/compute/v2/3716e192b1194365acb5595c8f92a862"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.72:9696/"}]}] Jun 16 15:13:58.827123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-TestShelveInstance-1074315081 Jun 16 15:13:58.827123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 3716e192b1194365acb5595c8f92a862 Jun 16 15:13:58.827123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-TestShelveInstance-1074315081 Jun 16 15:13:58.827123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User: tempest-TestShelveInstance-1074315081-project Jun 16 15:13:58.827123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default Jun 16 15:13:58.827123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default Jun 16 15:13:58.827123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Id: 0e6fbab71db54b698572bb8a7d033063 Jun 16 15:13:58.827123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-TestShelveInstance-1074315081-project Jun 16 15:13:58.827123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: method: > Jun 16 15:13:58.827123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: exception: Instance 781db76b-7a5f-47b1-8272-b4868d68c437 could not be found. Jun 16 15:13:58.827123 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: action_args: {'id': '781db76b-7a5f-47b1-8272-b4868d68c437'} Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 781db76b-7a5f-47b1-8272-b4868d68c437 could not be found. Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 15:13:58.828488 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 15:13:58.830342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 15:13:58.830342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 15:13:58.830342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 15:13:58.830342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 15:13:58.830342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 15:13:58.830342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 15:13:58.830342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 15:13:58.830342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 781db76b-7a5f-47b1-8272-b4868d68c437 could not be found. Jun 16 15:13:58.830342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:13:58.830342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 15:13:58.830342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:13:58.830342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 15:13:58.830342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 15:13:58.830342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 15:13:58.830342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 15:13:58.830342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 15:13:58.830342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 781db76b-7a5f-47b1-8272-b4868d68c437 could not be found. Jun 16 15:13:58.830342 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Jun 16 15:13:58.831984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f340288c-00a3-4a1a-bc3c-2da9bc34f29d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Returning 404 to user: Instance 781db76b-7a5f-47b1-8272-b4868d68c437 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 15:13:58.831984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f340288c-00a3-4a1a-bc3c-2da9bc34f29d tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437" status: 404 len: 111 microversion: 2.1 time: 0.029804 Jun 16 15:13:58.831984 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 721/1451] 10.222.0.72 () {58 vars in 1235 bytes} [Thu Jun 16 15:13:58 2022] GET /compute/v2.1/servers/781db76b-7a5f-47b1-8272-b4868d68c437 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 15:13:58.993247 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e8cd8ec2-7575-47b9-8ed8-1ed9ef910e4a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] Calling method '.version_select at 0x7faabaa1f5e0>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 15:13:59.014996 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e8cd8ec2-7575-47b9-8ed8-1ed9ef910e4a tempest-TestShelveInstance-1074315081 tempest-TestShelveInstance-1074315081-project] 10.222.0.72 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1156471918" status: 202 len: 0 microversion: 2.1 time: 0.026259 Jun 16 15:13:59.015513 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 731/1452] 10.222.0.72 () {58 vars in 1253 bytes} [Thu Jun 16 15:13:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1156471918 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 15:14:06.430253 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:14:06.430985 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Thu Jun 16 15:14:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:15:37.375176 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:15:37.375751 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Thu Jun 16 15:15:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:15:46.990675 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:15:46.991795 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Thu Jun 16 15:15:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:17:26.438931 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:17:26.439567 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Thu Jun 16 15:17:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:18:57.383411 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:18:57.384049 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Thu Jun 16 15:18:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:19:06.999285 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:19:06.999876 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Thu Jun 16 15:19:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:19:07.345550 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:19:07.346045 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Thu Jun 16 15:19:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:19:26.390104 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:19:26.390762 dv-cinder-837165-3-iscsi devstack@n-api.service[124590]: Thu Jun 16 15:19:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 15:19:27.351793 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 15:19:27.352434 dv-cinder-837165-3-iscsi devstack@n-api.service[124589]: Thu Jun 16 15:19:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!